... h1. Test Automation - CTI for TET - G11n Test Suite {toc}
---- h2. Basic Information
* *Project name: G11n Automated Testing* * *Short description:* The goal of this project is to provide g11n test suite using Common Test Infrastructure (CTI) framework and Test Environment Toolkit (TET) * *Responsible person(s) contact:* petr.hruska@sun.com
*Project Milestones:* * Phase 1 - create G11n basic test suite for OpenSolaris Binary Distro * Phase 2 - create an extended/regression test suites for OpenSolaris Binary Distro * Phase 3 - establish a project at OpenSolaris.org, create a mercurial repository there and place a test suites there * Phase 4 - contribute some tests to testing community at OpenSolaris.org
||Date || Comments || |07/21/2009 |Phase 1 started, evaluation of existing tests | |08/13/2009 |Phase 1 review, basic test suite created, currently having 10+ tests |
\\ h2. How to Start
* download *[TETlite | http://dlc.sun.com/osol/test/downloads/current/]* package * install CTI for TET by standard Solaris package installation tool *pkgadd* (available also for OpenSolaris) with root privileges: {code} pkgadd -d {package location} SUNWstc-tetlite {code}
* package is installed to */opt/SUNWstc-tetlite* by default
h3. Test Suite Execution
* the test suite execution is required to be done as root * setup the environment variables: {code} export TET_ROOT=/opt/SUNWstc-tetlite export TET_SUITE_ROOT=path_to_test_suite export CTI_ROOT=/opt/SUNWstc-tetlite/contrib/ctitools export PATH=$PATH:/opt/SUNWstc-tetlite/contrib/ctitools/bin {code}
* run script {code} # run_test TestSuiteName_ts scriptName {code}
\\ h2. Test Suites
*G11n Basic Test Suite* || Test ID || Status || Incl. to OpenSolaris Test Suite || Next Steps || Migrated/Created by || Style Review || Functionality Review || Putback Approval || || [logErrorCheck.ksh (OS001-logs,S004-logErrorCheck | S004logErrorCheck]|| ready || yes || copy install logs, warnings should not fail the test || Kristyna || READY || READY || || || [S001-init|S001-init] || ready || yes || - || Martin || need correction|| || || || [S002-core_files|S002-core_files] || ready || yes || transform to g11n regression test || Kristyna || READY || need corrections? || || || S003-pkgchk || in progress || yes || modify it for osol, create homepage || Martin || || || || |
|| [S005-bounCe | S005-bounCe] || ready || yes || provide also full log || Martin || need corrections || need corrections? || || || [S006-localedata | S006-localedata] || in progress || no || merge with S010 || Petko || || || || |
| || [S007-linkcheck|S007-linkcheck] || ready || yes || to be merged with S014 || Kristyna || READY ||
need corrections
finished
|| || |
|| S008-lc_check || on hold || no || migration currently not planned || Slavek || || || || || [S009-broken-links|S009-broken-links] || ready || yes || create homepage, check against g11n packages, include full links in log || Martin || need corrections || need corrections || || || [S010-validate-locale | S010-validate-locale] || ready || yes || S006 to be added, create summary in log, analyze failed status || Petko || READY? || need corrections || || || [S011-locale-regression-check | S011-locale-regression-check] || completed || yes || create homepage || Petko || READY? || need corrections || || |
| || [S012-binaryCat | S012-binaryCat] || ready || yes || sparc need to be check yet, missing results in report || Kristyna || READY ||
need corrections
finished
|| || |
|| [S013-mocheck] || ready || yes || create list of supported apps || Slavek || need corrections || || || || [S014-l10n_msgtest | S014-l10n_msgtest] || in progress || yes || merge with S007, create summary in log, evaluate if l10n mesg test is possible for firefox || Martin || || || || |
... || [S015-keyboards | S015-keyboards] || ready || yes || create homepage, check error reporting || Petko || READY? || need corrections || || || [S016-track_kb_changes | S016-track_kb_changes] || on hold || no || to be evaluated || Petko || || || || || [S017-duplicate|S017Duplicate] || ready || yes || check against g11n packages || Martin || need corrections || need corrections || || || S018-svcs || on hold || no || evaluate services from g11n perspective || Slavek || || || || |
|| [S019-login-logout | S019-login-logout] || ready || yes || create homepage, ensure session is started the same way as from gdm || Petko || need corrections || || || || [S020-sorting] || ready || yes || add missing golden files, attach full log || Slavek || need corrections || || || |
| || [S021-x_files | S021-x_files] || completed || yes || - || Kristyna || READY ||
need corrections
finished
|| || |
|| [S022-locale_map|S022-locale_map] || completed || yes || - || Martin || need corrections || || || || [correct_symlink|correct_symlink] || ready || yes || - || Martin || need corrections || need corrections || || |
... *NOTE:* Review collumns should contain these descriptors: *need corrections* - there are some issues that should be changed *in progress* - meaning is obvious *recheck* - corrections have been made and it is necessary to recheck current test (reviewer should recheck the test) *READY* - the review was succesfull
*Extended Test Suite* || Test ID || Status || Incl. to OpenSolaris Test Suite || Incl. to SXCE test suite || Migrated/Created by || || || || || || ||
---- h2. Links & Docs
* *Jim Walker's presentation:* http://opensolaris.org/os/community/testing/files/opensolaris_testing.pdf * *OpenSolaris Self-Service Testing project homepage:* http://www.opensolaris.org/os/community/testing/selftest/ * *Information on the OpenSolaris test farm is at:* http://opensolaris.org/os/community/testing/testfarm * *OpenSolaris users can access the test farm at:* http://test.opensolaris.org/testfarm * *Information on the test farm zone implementation is at:* http://opensolaris.org/os/community/testing/testfarm/zones
* *Test Suites:* http://opensolaris.org/os/community/testing/testsuites/ ** STF - Solaris Test Framework: http://opensolaris.org/os/community/testing/testsuites/stf/ ** TET - Test Environment Toolkit: http://tetworks.opengroup.org/tet/ more documentation on: http://tetworks.opengroup.org/documents/docs37.htm *** CTI for TET - Common Test Infrastructure for TET: http://opensolaris.org/os/community/testing/testsuites/ctifortet/ {color:red}CTI framework is recommended for creating new test suites.{color} See discuss thread: http://www.opensolaris.org/jive/thread.jspa?threadID=67101&tstart=0
* *Shell coding style guidelines:* http://www.opensolaris.org/os/project/shell/shellstyle/
\\ ---- |