Test cases and Quality Assurance

Back

QA-Audit

Every night, the script .../maintenance/qa-monitor/run (included in the package) will be executed to detect possible problems automatically.

* Check if every deleted TLD has a notice ( https://whois.viathinksoft.de/iana-utils/tld-watcher/tld_deleted_list.php )
[ OK ]
* Check if every TLD has a single whois entry
[ OK ]
* Check if TLDs have the latest Root-Whois-Server URLs ( https://whois.viathinksoft.de/iana-utils/root-whois-watcher/root_whois_list.php )
Note: For following TLDs, the root whois server may be commented out: AC, SH, VU, MQ, GF, GE
[ OK ]
* Check if there is a newer official version of gwhois which needs to be merged with the ViaThinkSoft fork
[ OK ]
* Check if IANA has (probably) a TLD whois list in https://data.iana.org/TLD/
[ OK ]
* Check if testcases require attention
[ !! ] 486 testcases require attention
* Check the status of whois-ping
[ OK ]
* Check syntax of all script files (Perl, PHP)
[ OK ]

Testcases

During the nightly build, our server automatically runs a test against queries using the tool testcase-tools included in the package. As soon as an output is not as the expected result, the result will be saved and the developer will be asked if he wants to update the testcase, if the change was legitimate. The testcase tool is included in the package and can be used by everyone to define and watch testcases. Here is our current nightly testcase result:

Here is the output of .../maintenance/qa-monitor/testcases/status which is included in the package:

Query                          Last activity        Status
----------------------------------------------------------------------------------
.x                             never                Unexpected head line
test.ใƒ†ใ‚นใƒˆ                 never                Unexpected head line
2002:2030:4050::2              never                No expected output defined
AS1228                         never                No expected output defined
AS327680                       never                No expected output defined
AS681                          never                No expected output defined
AS131072                       never                No expected output defined
AS1                            never                No expected output defined
AS393216                       never                No expected output defined
AS278                          never                No expected output defined
AS262144                       never                No expected output defined
AS224                          never                No expected output defined
AS196608                       never                No expected output defined
C223523-AERO                   never                No expected output defined
D322-AERO                      never                No expected output defined
ORG-ARIN1-AFRINIC              never                No expected output defined
AFRINIC-042005                 never                No expected output defined
R32-LRCC                       never                Unexpected head line
D52707-LRCC                    never                Unexpected head line
MAINT-APNIC-AP                 never                No expected output defined
DNS3-AP                        never                No expected output defined
DOCKM1-ARIN                    never                No expected output defined
C270-ASIA                      never                No expected output defined
R118-ASIA                      never                Unexpected head line
D24374-ASIA                    never                Unexpected head line
R2-ASIA                        never                Unexpected head line
NAIV1902732-NICAT              never                No expected output defined
NAR1899634-NICAT               never                No expected output defined
UH567003-NICAT                 never                No expected output defined
AT-DOM                         never                Unexpected head line
CONNECT-AU                     never                No expected output defined
D712-BIZ                       never                Unexpected head line
RM1-CKNIC                      never                No expected output defined
CK-NIC-MNT                     never                No expected output defined
20030310s10001s00012956-cn     never                Unexpected head line
D734276-CO                     never                Unexpected head line
D10120103-CONE                 never                No expected output defined
COCO-10119103                  never                No expected output defined
DENIC-8                        never                No expected output defined
DENIC-8-RC39151342             never                No expected output defined
JGT6-ESNIC-F4                  never                Unexpected head line
SA28789-ESNIC-F4               never                Unexpected head line
AFNI21-FRNIC                   never                No expected output defined
C270-LRMS                      never                No expected output defined
D217-LRMS                      never                Unexpected head line
R145-LRMS                      never                Unexpected head line
SK222JP                        never                No expected output defined
HW1733JP                       never                No expected output defined
MX-UNAM1-LACNIC                never                No expected output defined
C728-MUSEUM                    never                No expected output defined
D6136003-MUSEUM                never                No expected output defined
2891347DOMAIN-NAME             never                Unexpected head line
222REGISTRAR-NAME              never                No expected output defined
3110912CONTACT-NAME            never                No expected output defined
1420418HOST-NAME               never                Unexpected head line
UNA78O-NORID                   never                No expected output defined
TEST_1255595960_ORGZA          never                Unexpected head line
RIPE-NCC-RIS-MNT               never                No expected output defined
RISM-RIPE                      never                No expected output defined
RUCENTER-REG-FID               never                No expected output defined
RU-CENTER-REG-RIPN             never                No expected output defined
R138-LRCC                      never                Unexpected head line
D1972475-LRCC                  never                Unexpected head line
SGNIC-ORGSI134835              never                Unexpected head line
DMZ9-SIXXS                     never                No expected output defined
D583364-TEL                    never                Unexpected head line
D99505-TRAVEL                  never                Unexpected head line
ST101-UANIC                    never                No expected output defined
ICMFCON00000001                never                Unexpected head line
D131092-XXX                    never                Unexpected head line
R3189-XXX                      never                Unexpected head line
210.8.0.0                      never                No expected output defined
61.192.0.0                     never                No expected output defined
61.72.0.0                      never                No expected output defined
41.0.0.0                       never                No expected output defined
200.128.0.0                    never                No expected output defined
224.0.0.0                      never                No expected output defined
24.232.0.0                     never                No expected output defined
2.0.0.0                        never                No expected output defined
61.216.0.0                     never                No expected output defined
3ffe::                         never                No expected output defined
2c00::                         never                No expected output defined
2400::                         never                No expected output defined
2620::                         never                No expected output defined
2800::                         never                No expected output defined
2a00::                         never                No expected output defined
oid:3                          never                No expected output defined
oid:2.999                      never                No expected output defined
108.171.243.10                 never                No expected output defined
68.233.238.33                  never                No expected output defined
2001:0000:4136:e378:8000:63bf:3fff:fdd2 never                No expected output defined
de                             never                No expected output defined
com                            never                No expected output defined
net                            never                No expected output defined
tld net                        never                No expected output defined, outdated
tld jp                         never                No expected output defined, outdated
nic.ac                         never                No expected output defined
invalid.ac                     never                No expected output defined
manchester.ac                  never                No expected output defined
ru.ac.za                       never                No expected output defined
andorratelecom.ad              never                No expected output defined
aeda.net.ae                    never                No expected output defined
aeda.ae                        never                No expected output defined
whois.aero                     never                No expected output defined
nic.af                         never                No expected output defined
nic.ag                         never                No expected output defined
whois.ai                       never                No expected output defined
offshore.ai                    never                No expected output defined
akep.al                        never                No expected output defined
nic.am                         never                No expected output defined
una.an                         never                No expected output defined
nexus.ao                       never                No expected output defined
icenic.aq                      never                No expected output defined
cancilleria.gov.ar             never                No expected output defined
in-addr.arpa                   never                No expected output defined
nic.as                         never                No expected output defined
nic.asia                       never                No expected output defined
nic.at                         never                No expected output defined
audns.net.au                   never                No expected output defined
setarnet.aw                    never                No expected output defined
regeringen.ax                  never                No expected output defined
fa.az                          never                No expected output defined
intrans.ba                     never                No expected output defined
telecoms.gov.bb                never                No expected output defined
mopt.gov.bd                    never                No expected output defined
btcl.net.bd                    never                No expected output defined
invalid.bd                     never                No expected output defined
dns.be                         never                No expected output defined
arce.bf                        never                No expected output defined
register.bg                    never                No expected output defined
batelco.com.bh                 never                No expected output defined
nic.bi                         never                Unexpected head line
whois.biz                      never                No expected output defined
nic.bj                         never                No expected output defined
nic.bl                         never                No expected output defined
gov.bm                         never                No expected output defined
brunet.bn                      never                No expected output defined
nic.bo                         never                No expected output defined
registro.br                    never                No expected output defined
cert.br                        never                No expected output defined
cob.edu.bs                     never                No expected output defined
bt.bt                          never                No expected output defined
nic.bu                         never                No expected output defined
nic.bv                         never                No expected output defined
btc.bw                         never                No expected output defined
tld.by                         never                No expected output defined
belizenic.bz                   never                No expected output defined
bcs.edu.bz                     never                No expected output defined
lv.com.bz                      never                No expected output defined
cira.ca                        never                No expected output defined
eonline.ca                     never                No expected output defined
whois.cat                      never                No expected output defined
nic.cc                         never                No expected output defined
nic.cd                         never                No expected output defined
socatel.cf                     never                No expected output defined
nic.cg                         never                No expected output defined
domian.ch                      never                No expected output defined
nic.ci                         never                No expected output defined
telecom.co.ck                  never                No expected output defined
nic.cl                         never                No expected output defined
camnet.cm                      never                No expected output defined
register.cm                    never                No expected output defined
cnnic.cn                       never                No expected output defined
nic.co                         never                No expected output defined
invalidx.co                    never                No expected output defined
test.co.za                     never                No expected output defined
verisign-grs.com               never                No expected output defined
dracenmarx.com                 never                No expected output defined
viathinksoft.com               never                No expected output defined
nic.coop                       never                No expected output defined
ns.cr                          never                No expected output defined
nic.cs                         never                No expected output defined
ceniai.inf.cu                  never                No expected output defined
nic.cu                         never                No expected output defined
invalid.cu                     never                No expected output defined
anac.cv                        never                No expected output defined
uts.cw                         never                No expected output defined
nic.cx                         never                No expected output defined
ucy.ac.cy                      never                No expected output defined
nic.cz                         never                No expected output defined
nic.dd                         never                No expected output defined
denic.de                       never                No expected output defined
nic.dj                         never                No expected output defined
dk-hostmaster.dk               never                No expected output defined
nic.dm                         never                No expected output defined
courts.co.dm                   never                No expected output defined
pucmm.edu.do                   never                No expected output defined
nic.dz                         never                No expected output defined
nic.ec                         never                No expected output defined
educause.edu                   never                No expected output defined
tld.ee                         never                No expected output defined
egregistry.eg                  never                No expected output defined
noc.net.er                     never                No expected output defined
nic.es                         never                No expected output defined
crimestoppers.es               never                No expected output defined
ethionet.et                    never                No expected output defined
whois.eu                       never                No expected output defined
whois.fi                       never                No expected output defined
usp.ac.fj                      never                No expected output defined
fidc.co.fk                     never                No expected output defined
mail.fm                        never                No expected output defined
nic.fo                         never                No expected output defined
nic.fr                         never                No expected output defined
gabontelecom.ga                never                No expected output defined
dfhnet.dra.hmg.gb              never                No expected output defined
nic.gd                         never                No expected output defined
sanet.ge                       never                No expected output defined
nic.gf                         never                No expected output defined
whois.gg                       never                No expected output defined
nic.gh                         never                No expected output defined
gaf.mil.gh                     never                No expected output defined
yellowpages.gh                 never                No expected output defined
sapphire.gi                    never                No expected output defined
nic.gl                         never                No expected output defined
nic.gm                         never                No expected output defined
areeba.com.gn                  never                No expected output defined
dotgov.gov                     never                No expected output defined
ntgroup.gp                     never                No expected output defined
invalid.gp                     never                No expected output defined
orange-getesa.gq               never                No expected output defined
ics.forth.gr                   never                No expected output defined
nic.gs                         never                No expected output defined
uvg.edu.gt                     never                No expected output defined
invalid.gt                     never                No expected output defined
dollar.com.gu                  never                No expected output defined
register.gw                    never                No expected output defined
registry.gy                    never                No expected output defined
hkirc.hk                       never                No expected output defined
registry.hm                    never                No expected output defined
rds.org.hn                     never                No expected output defined
dns.hr                         never                No expected output defined
nic.ht                         never                No expected output defined
nic.hu                         never                No expected output defined
iptek.net.id                   never                No expected output defined
domainregistry.ie              never                No expected output defined
isoc.org.il                    never                No expected output defined
nic.im                         never                No expected output defined
afilias.in                     never                No expected output defined
afilias.info                   never                No expected output defined
ectel.int                      never                No expected output defined
nic.io                         never                No expected output defined
cmc.iq                         never                No expected output defined
nic.ir                         never                No expected output defined
isnic.is                       never                No expected output defined
nic.it                         never                No expected output defined
whois.je                       never                No expected output defined
uwimona.edu.jm                 never                No expected output defined
nitc.gov.jo                    never                No expected output defined
goto.jobs                      never                No expected output defined
jprs.jp                        never                No expected output defined
kenic.or.ke                    never                No expected output defined
domain.kg                      never                No expected output defined
dns.net.kh                     never                No expected output defined
nic.ki                         never                No expected output defined
comorestelecom.km              never                No expected output defined
knnic.kn                       never                No expected output defined
star-co.net.kp                 never                No expected output defined
nic.kr                         never                No expected output defined
moc.kw                         never                No expected output defined
icta.ky                        never                No expected output defined
nic.kz                         never                No expected output defined
nic.la                         never                No expected output defined
aub.edu.lb                     never                No expected output defined
isisworld.lc                   never                No expected output defined
nic.li                         never                No expected output defined
cse.mrt.ac.lk                  never                No expected output defined
nimbaunitedfc.com.lr           never                No expected output defined
denver.co.ls                   never                No expected output defined
metolong.org.ls                never                No expected output defined
invalidx.ls                    never                No expected output defined
domreg.lt                      never                No expected output defined
dns.lu                         never                No expected output defined
nic.lv                         never                No expected output defined
adidas.lv                      never                No expected output defined
nic.ly                         never                Unexpected head line
registre.ma                    never                No expected output defined
gouv.mc                        never                No expected output defined
nic.md                         never                No expected output defined
nic.me                         never                No expected output defined
nic.mf                         never                No expected output defined
nic.mg                         never                No expected output defined
dgt.mh                         never                No expected output defined
nic.mil                        never                No expected output defined
ultra.ultra.com.mk             never                No expected output defined
sotelma.ml                     never                No expected output defined
mptmail.net.mm                 never                No expected output defined
nic.mn                         never                No expected output defined
umac.mo                        never                No expected output defined
mtld.mobi                      never                No expected output defined
nic.mp                         never                No expected output defined
microforce.mq                  never                No expected output defined
lechateau.mq                   never                No expected output defined
cse.mr                         never                No expected output defined
nic.ms                         never                No expected output defined
nic.org.mt                     never                No expected output defined
nic.mu                         never                No expected output defined
whois.museum                   never                No expected output defined
dhiraagu.com.mv                never                No expected output defined
sdnp.org.mw                    never                No expected output defined
whois.mx                       never                No expected output defined
domainregistry.my              never                No expected output defined
zebra.uem.mz                   never                No expected output defined
na-nic.com.na                  never                No expected output defined
nic.name                       never                No expected output defined
suggest.name                   never                No expected output defined
whois.nc                       never                No expected output defined
amnic.ne                       never                No expected output defined
amnic.net                      never                No expected output defined
nic.net.nf                     never                No expected output defined
nic.net.ng                     never                No expected output defined
nic.ni                         never                No expected output defined
domain-registry.nl             never                No expected output defined
norid.no                       never                No expected output defined
smith.nom.za                   never                No expected output defined
mos.com.np                     never                No expected output defined
naurugov.nr                    never                No expected output defined
invalid.nr                     never                No expected output defined
greenyouthgeneration.co.nr     never                No expected output defined
xxxxxxxx.co.nr                 never                No expected output defined
test.de.nr                     never                No expected output defined
xxxxxxxxxx.de.nr               never                No expected output defined
ronlaw.gov.nr                  never                No expected output defined
invalid.gov.nr                 never                No expected output defined
cenpac.net.nr                  never                No expected output defined
invalid.net.nr                 never                No expected output defined
nic.nu                         never                No expected output defined
srs.net.nz                     never                No expected output defined
registry.om                    never                No expected output defined
einsurance.com.om              never                No expected output defined
pir.org                        never                No expected output defined
test.org.za                    never                No expected output defined
utp.ac.pa                      never                No expected output defined
invalid.pa                     never                No expected output defined
yachay.pe                      never                No expected output defined
spt.gov.pf                     never                No expected output defined
unitech.ac.pg                  never                No expected output defined
dot.ph                         never                No expected output defined
invalid.ph                     never                No expected output defined
pknic.net.pk                   never                No expected output defined
test.com.pk                    never                No expected output defined
invalid.pk                     never                No expected output defined
dns.pl                         never                No expected output defined
nic.pm                         never                No expected output defined
pitcairn.gov.pn                never                No expected output defined
invalid.pn                     never                No expected output defined
nothingknown.post              never                No expected output defined
nic.pr                         never                No expected output defined
registrypro.pro                never                No expected output defined
gcc.gov.ps                     never                No expected output defined
dns.pt                         never                Unexpected head line
pwregistry.pw                  never                No expected output defined
nic.py                         never                No expected output defined
teleguia.com.py                never                No expected output defined
una.py                         never                No expected output defined
registry.qa                    never                No expected output defined
nic.re                         never                No expected output defined
rotld.ro                       never                No expected output defined
rnids.rs                       never                No expected output defined
tcinet.ru                      never                No expected output defined
brd.rw                         never                No expected output defined
nic.rw                         never                No expected output defined
nic.net.sa                     never                No expected output defined
nic.net.sb                     never                No expected output defined
freedomchurch.sc               never                No expected output defined
isoc.sd                        never                No expected output defined
iis.se                         never                No expected output defined
sgnic.sg                       never                No expected output defined
nic.sh                         never                No expected output defined
arnes.si                       never                No expected output defined
unknown-tld-sj                 never                Unexpected head line
nic.sj                         never                No expected output defined
sk-nic.sk                      never                No expected output defined
afcom.sl                       never                No expected output defined
nic.sm                         never                No expected output defined
nic.sn                         never                No expected output defined
nic.so                         never                No expected output defined
somalisat.so                   never                No expected output defined
telesur.sr                     never                No expected output defined
nic.ss                         never                No expected output defined
nic.st                         never                No expected output defined
nic.su                         never                No expected output defined
WORLDOFWARPLANES.SU            never                No expected output defined
di.uca.edu.sv                  never                No expected output defined
whois.sx                       never                No expected output defined
nic.sx                         never                No expected output defined
registry.sx                    never                No expected output defined
tld.sy                         never                No expected output defined
sispa.org.sz                   never                No expected output defined
adamsnames.tc                  never                No expected output defined
icc.tc                         never                No expected output defined
intnet.td                      never                No expected output defined
nic.tel                        never                No expected output defined
knysna.tel                     never                No expected output defined
nic.tf                         never                No expected output defined
cafe.tg                        never                No expected output defined
thnic.co.th                    never                No expected output defined
nic.tj                         never                No expected output defined
mintrans.tj                    never                No expected output defined
dot.tk                         never                No expected output defined
nic.tl                         never                No expected output defined
nic.tm                         never                No expected output defined
ati.tn                         never                No expected output defined
nouvelair.com.tn               never                No expected output defined
tonic.to                       never                No expected output defined
fail.to                        never                No expected output defined
nic.tp                         never                No expected output defined
nic.tr                         never                No expected output defined
nic.travel                     never                No expected output defined
nic.tt                         never                No expected output defined
invalid.tt                     never                No expected output defined
tuvalu.tv                      never                No expected output defined
twnic.net.tw                   never                No expected output defined
tznic.or.tz                    never                No expected output defined
whois.ua                       never                No expected output defined
whois.co.ug                    never                No expected output defined
nic.uk                         never                No expected output defined
nic.um                         never                No expected output defined
nic.us                         never                No expected output defined
nic.org.uy                     never                No expected output defined
cctld.uz                       never                No expected output defined
vatican.va                     never                No expected output defined
archiviosegretovaticano.va     never                No expected output defined
mail.gov.vc                    never                No expected output defined
nic.ve                         never                Unexpected head line
nic.vg                         never                No expected output defined
bingo.vg                       never                No expected output defined
rotarystthomas.vi              never                No expected output defined
vnnic.net.vn                   never                No expected output defined
tenmien.vn                     never                No expected output defined
nic.vu                         never                No expected output defined
invalid.vu                     never                No expected output defined
nic.wf                         never                No expected output defined
website.ws                     never                No expected output defined
xn--fsqu00a.xn--0zwm56d        never                No expected output defined
xn--p1b6ci4b4b3a.xn--11b5bs3a9aj6g never                No expected output defined
xn--ok0b82d83uwleqxax72c.xn--3e0b707e never                No expected output defined
unknown-tld-xn--45brj9c        never                Unexpected head line
xn--e1afmkfd.xn--80akhbyknj4f  never                No expected output defined
xn--e1aybc.xn--80ao21a         never                No expected output defined
xn--d1aholi.xn--90a3ac         never                No expected output defined
xn--9n2bp8q.xn--9t4b11yi5a     never                No expected output defined
unknown-tld-xn--clchc0ea0b2g2a9gcd never                Unexpected head line
xn--fdbk5d8ap9b8a8d.xn--deba0ad never                No expected output defined
xn--cjrz24bfyfdjk2v4b20c.xn--fiqs8s never                No expected output defined
xn--4gqsa60bk09hfz2a.xn--fiqz9s never                No expected output defined
unknown-tld-xn--fpcrj9c3d      never                Unexpected head line
xn--fzc3a2azd8dsa2ktat.xn--fzc2c9e2c never                No expected output defined
xn--fsqu00a.xn--g6w251d        never                No expected output defined
unknown-tld-xn--gecrj9c        never                Unexpected head line
unknown-tld-xn--h2brj9c        never                Unexpected head line
xn--mgbh0fb.xn--hgbk6aj7f53bba never                No expected output defined
xn--zkc6cc5bi7f6e.xn--hlcj6aya9esc7a never                No expected output defined
xn--q8sz05f.xn--55qx5d.xn--j6w193g never                No expected output defined
xn--fjqw22h.xn--j6w193g        never                No expected output defined
xn--hxajbheg2az3al.xn--jxalpdlp never                No expected output defined
xn--mgbh0fb.xn--kgbechtv       never                No expected output defined
xn--8mr3z850bhx6ablr.xn--kprw13d never                No expected output defined
xn--rlsx8k.xn--kpry57d         never                No expected output defined
unknown-tld-xn--lgbbat1ad8j    never                Unexpected head line
nothingknown.xn--mgb9awbf      never                No expected output defined
xn--ogbh0eio.xn--mgbaam7a8h    never                No expected output defined
xn--mgbbv2b6cav.xn--mgbayh7gpa never                No expected output defined
unknown-tld-xn--mgbbh1a71e     never                Unexpected head line
xn------nzeabcaancne6mxa3pircddecvqfa4bhn4cg.xn--mgbc0a9azcg never                No expected output defined
xn--mgbaa2bbjj1kkm8ak.xn--mgberp4a5d4ar never                No expected output defined
nothingknown.xn--mgbx4cd0ab    never                No expected output defined
xn--12c3cwavs1kc8c9b.xn--o3cw4h never                No expected output defined
xn--hgbo2h.xn--ogbpf8fl        never                No expected output defined
xn--80aajfpdawelcil0c2d.xn--p1ai never                No expected output defined
xn--pgbus4b3a.xn--pgbs0dh      never                No expected output defined
unknown-tld-xn--s9brj9c        never                Unexpected head line
xn--ggblala6cyf.xn--wgbh1c     never                No expected output defined
xn--mgbeh7c1c.xn--wgbl6a       never                No expected output defined
xn--rlcuo9h.xn--wlcbmbhil0gb5a8kc.xn--xkc2al3hye2a never                No expected output defined
unknown-tld-xn--xkc2dl3a5ee0h  never                Unexpected head line
unknown-tld-xn--yfro4i67o      never                Unexpected head line
xn--mgbad0esc.xn--ygbi2ammx    never                No expected output defined
xn--r8jz45g.xn--zckzah         never                No expected output defined
nic.xxx                        never                No expected output defined
y.net.ye                       never                No expected output defined
nic.yt                         never                No expected output defined
nic.yu                         never                No expected output defined
zamnet.zm                      never                No expected output defined
nic.zr                         never                No expected output defined
telone.co.zw                   never                No expected output defined
telone-invalid.co.zw           never                No expected output defined