Globalization(G11n) OpenSolaris Binary Distro Test Plan

Main G11n OpenSolaris binary distro test goal is to test entire distribution and ensure the system is working and is usable from global perspective, taking into account wide variations in regions, languages, and cultures. Localization (l10n) and internationalization (i18n) of OpenSolaris operating system introduces multilingual support to the product through the addition of locale support and offers language specific support for the GUI for pre-selected languages and regions. This can result in certain issues and non-expected behavior that needs to be tested

The objectives of this test plan are:

• Outline the tasks required to perform relevant system level testing for the each OpenSolaris binary distro release from g11n perspective.
• To address test strategies, tools, test environment and resources, configurations and detailed system test coverage as well as to address the testing outcomes (deliverables), dependencies and test execution criteria.
• Communicate to G11N community and other interested groups the test coverage planned on the OpenSolaris binary distro releases.

Test Strategy

G11n testing covers both localization and internationalization testing and also distinguishes between Solaris language and locale. Currently there is different language/locale support delivered to OpenSolaris binary distro liveCD, its Installer and to network repository. As of nature of OpenSolaris G11n Test Group community we are not applying regular build to build test cycles approach, but long-term testing across particular areas of OpenSolaris Binary Distro. Every time a new test build is release we upgrade our test environment to assure we are testing the latest bits available.

G11n Features Coverage

Thanks to limited space on LiveCD, it's not possible to deliver all the g11n features within LiveCD environment. Currently we have two versions of LiveCD:

• Primary Languages LiveCD - lower compression but better performance and support for the 12 main languages
• All Languages (Global) LiveCD - better compression but lower performance and support for all languages

Full g11n support is always available through the package repositories

The G11N contents of live CD

• Locale
  • Primary CD - UTF-8 locales for 12 langs (fr,it,de,es,sv,ja,ko,zhCN,zhTW,ru,pt_BR)
  • Global CD - all available UTF-8 locales (except UTF-8@xxx)
• Iconv - basic unicode conversions
• Fonts
• Input methods
• Xserver keyboard layouts

• Localization
  • Gnome(msg), Firefox, Thunderbird
  • Caiman installer
    • Primary CD - 12 langs (fr,it,de,es,sv,ja,ko,zhCN,zhTW,ru,pt_BR)

The content of OS.o net repository

More redistributable components will be available on OS.o net repository.

• All available locales including non-UTF-8 locales
• More fonts (ThaiFonts-Scalable thai-ttf, Indic ttf Fonts,
• SCIM (Smart Common Input Method platform)
• IIIMF - additional Asian LEs
• More translations including OpenSolaris ON messages.

Test Approach

As of nature of OpenSolaris G11n Test Group we are not applying rergular build to build test cycles approach, but long-term testing across particular areas of OpenSolaris Binary Distro.

LiveCD Sanity

• Goal: Primary and LiveCD works correctly and provide expected i18n and l10n for particular languages
  • user can boot and login to desktop environment for all available locales on Primary and Global LiveCD
  • I18n (keyboard setting, fonts, locale data ..) and l10n support (UI translations) is available and works correctly
  • Key desktop applications (Firefox, Thunderbird, DDU ...) are working as expected under available locales
  • Test Matrix

Install and Upgrade

• Goal: All g11n bits can be installed and upgraded without any issues
  • G11n packages are fully installable, having correct dependencies
  • Installed language support provides expected i18n and l10n support
  • Update of G11n packages is possible and does not break any functionality
  • GUI and text package manager work for all locales and are properly localized
  • Test Matrix

New features and New Localization Testing

• Goal: To test deeply new features delivered for a release. This area may overlap with other component specific testing other. In such case we are testing new deliveries with higher priority in scope of those particular areas.
  • New locales - ka_GE (Georgia), be_BY (Belarus), es_US (Spanish - USA) --> covered by other areas
  • Integration of Wenquan Zenhei font --> covered by fotn testing
  • Integration of libm17n and scim-m17n to OpenSolaris to finish the stack of SCIM --> tested by volunteers
  • New localization testing - Test Matrix

Keyboard Input

• Goal: All national specific characters can be correctly inputed
  • it is possible to select keyboard layout / input method using IIIMF
  • Xserver configuration - keyboards map testing
  • Compose key testing
  • National keyboard input works correctly for different types of applications (gtk+, OpenOffice.org, Java, etc ..)
  • Test Matrix
  • Test Matrix2

Font Quality

• *Main Goal: all national specific characters are correctly displayed with expected quality
  • Default fonts setting works for all locales and introduce required national specific support in proper quality
  • Closed fonts can be downloaded from extra repository and can be used after installation
  • Provided fonts are available and works correctly for different types of applications (gtk+, OpenOffice.org, Java, etc ..)
  • Test Matrix

Locale Data

• Main Goal: All environmental variables are correctly set, locale is having correct locale data (date formating, currency, sorting etc ..)
  • Date and time is displayed correctly in GUI and text interfaces (date and cal commands, Clock applet ..)
  • sorting works as expected and does not have negative performance impact
  • checking locale data content against CLDR project
  • Test Matrix

Desktop I18n & L10n Sanity

• Main Goal: Available applications are fully functional under different locales and localized (focusing on key applications e.g. Firefox/Thunderbird )
  • testing OpenSolaris Binary Distro specific components (Time slider, registration, system settings ...)
  • Gnome environment and gtk+ applications
  • Mozilla and email applications (Firefox, Thunderbird, Evolution ...)
  • OpenOffice.org
  • Test Matrix

User Based Scenarios

• Main Goal: Kind of random/user based testing with just rough guidelines to simulate usual end user tasks all done under particular locale/language environment
  • Office work - creating and printing documents, emails, etc ..
  • Multimedia and Communication - playing audio&video, browsing, burning, instant messaging
  • Administration and Development - basic admin tasks, system settings and devtools sanity
  • Test Matrix

Delivered Fixes Verification

• Main Goal: Assure all delivered fixes are verified in official builds
  • verify and close or reopen delivered bugs

Reporting issues

To report bug, use OpenSolaris Bugzilla tracking system. Please read and follow Bug Writting Guidelines when submitting a new issue.

OpenSolaris Bugzilla http://defect.opensolaris.org/bz/

Before reporting new bug, search for existing issues to avoid submitting duplicate bugs.

Testing Outcome

Links & Docs

• G11n new features - 2009.06 project status: http://wikis.sun.com/display/g11n/2009.06+project+status