Calibre-Web Tests

Tested environment

Program library	Installed Version	Test class
Platform	Linux 5.8.0-45-generic #51~20.04.1-Ubuntu SMP Tue Feb 23 13:46:31 UTC 2021 x86_64 x86_64	Basic
Python	3.8.5	Basic
Babel	2.8.1	Basic
backports-abc	0.5	Basic
Flask	1.1.2	Basic
Flask-Babel	2.0.0	Basic
Flask-Login	0.5.0	Basic
Flask-Principal	0.4.0	Basic
iso-639	0.4.5	Basic
Jinja2	2.11.3	Basic
PyPDF3	1.0.3	Basic
pytz	2021.1	Basic
requests	2.24.0	Basic
singledispatch	3.4.0.4	Basic
six	1.15.0	Basic
SQLAlchemy	1.3.23	Basic
tornado	6.1	Basic
Unidecode	1.1.2	Basic
Wand	0.6.6	Basic
Werkzeug	1.0.1	Basic
google-api-python-client	2.0.2	TestEbookConvertCalibreGDrive
httplib2	0.19.0	TestEbookConvertCalibreGDrive
lxml	4.6.2	TestEbookConvertCalibreGDrive
oauth2client	4.1.3	TestEbookConvertCalibreGDrive
PyDrive2	1.8.1	TestEbookConvertCalibreGDrive
PyYAML	5.4.1	TestEbookConvertCalibreGDrive
google-api-python-client	2.0.2	TestEbookConvertGDriveKepubify
httplib2	0.19.0	TestEbookConvertGDriveKepubify
lxml	4.6.2	TestEbookConvertGDriveKepubify
oauth2client	4.1.3	TestEbookConvertGDriveKepubify
PyDrive2	1.8.1	TestEbookConvertGDriveKepubify
PyYAML	5.4.1	TestEbookConvertGDriveKepubify
comicapi	2.2.0	TestEditAdditionalBooks
lxml	4.6.2	TestEditAdditionalBooks
rarfile	4.0	TestEditAdditionalBooks
lxml	4.6.2	TestEditBooks
google-api-python-client	2.0.2	TestEditBooksOnGdrive
httplib2	0.19.0	TestEditBooksOnGdrive
lxml	4.6.2	TestEditBooksOnGdrive
oauth2client	4.1.3	TestEditBooksOnGdrive
PyDrive2	1.8.1	TestEditBooksOnGdrive
PyYAML	5.4.1	TestEditBooksOnGdrive
google-api-python-client	2.0.2	TestSetupGdrive
httplib2	0.19.0	TestSetupGdrive
oauth2client	4.1.3	TestSetupGdrive
PyDrive2	1.8.1	TestSetupGdrive
PyYAML	5.4.1	TestSetupGdrive
goodreads	0.3.2	TestGoodreads
python-Levenshtein	0.12.2	TestGoodreads
jsonschema	3.2.0	TestKoboSync
Flask-SimpleLDAP	1.4.0	TestLdapLogin
jsonschema	3.2.0	TestLdapLogin
python-ldap	3.3.1	TestLdapLogin
Flask-Dance	3.3.1	TestOAuthLogin
SQLAlchemy-Utils	0.36.8	TestOAuthLogin
lxml	4.6.2	TestUploadPDF

Test Group/Test case	Count	Pass	Fail	Error	Skip	View
TestAnonymous	13	13	0	0	0	Detail
TestAnonymous - test_check_locale_guest	PASS
TestAnonymous - test_guest_about	PASS
TestAnonymous - test_guest_change_visibility_category	PASS
TestAnonymous - test_guest_change_visibility_format	PASS
TestAnonymous - test_guest_change_visibility_hot	PASS
TestAnonymous - test_guest_change_visibility_language	PASS
TestAnonymous - test_guest_change_visibility_publisher	PASS
TestAnonymous - test_guest_change_visibility_rated	PASS
TestAnonymous - test_guest_change_visibility_rating	PASS
TestAnonymous - test_guest_change_visibility_series	PASS
TestAnonymous - test_guest_random_books_available	PASS
TestAnonymous - test_guest_restricted_settings_visibility	PASS
TestAnonymous - test_guest_visibility_sidebar	PASS
TestCli	8	7	0	0	1	Detail
TestCli - test_already_started	PASS
TestCli - test_bind_to_single_interface	PASS
TestCli - test_cli_SSL_files	PASS
TestCli - test_cli_different_folder	PASS
TestCli - test_cli_different_settings_database	PASS
TestCli - test_cli_gdrive_location	SKIP Not Implemented
TestCli - test_environ_port_setting	PASS
TestCli - test_settingsdb_not_writeable	PASS
TestCoverEditBooks	1	1	0	0	0	Detail
TestCoverEditBooks - test_upload_jpg	PASS
TestDeleteDatabase	1	1	0	0	0	Detail
TestDeleteDatabase - test_delete_books_in_database	PASS
TestEbookConvertCalibre	11	11	0	0	0	Detail
TestEbookConvertCalibre - test_convert_deactivate	PASS
TestEbookConvertCalibre - test_convert_email	PASS
TestEbookConvertCalibre - test_convert_failed_and_email	PASS
TestEbookConvertCalibre - test_convert_only	PASS
TestEbookConvertCalibre - test_convert_parameter	PASS
TestEbookConvertCalibre - test_convert_wrong_excecutable	PASS
TestEbookConvertCalibre - test_email_failed	PASS
TestEbookConvertCalibre - test_email_only	PASS
TestEbookConvertCalibre - test_kindle_send_not_configured	PASS
TestEbookConvertCalibre - test_ssl_smtp_setup_error	PASS
TestEbookConvertCalibre - test_starttls_smtp_setup_error	PASS
TestEbookConvertCalibreGDrive	6	6	0	0	0	Detail
TestEbookConvertCalibreGDrive - test_convert_email	PASS
TestEbookConvertCalibreGDrive - test_convert_failed_and_email	PASS
TestEbookConvertCalibreGDrive - test_convert_only	PASS
TestEbookConvertCalibreGDrive - test_convert_parameter	PASS
TestEbookConvertCalibreGDrive - test_email_failed	PASS
TestEbookConvertCalibreGDrive - test_email_only	PASS
TestEbookConvertKepubify	3	3	0	0	0	Detail
TestEbookConvertKepubify - test_convert_deactivate	PASS
TestEbookConvertKepubify - test_convert_only	PASS
TestEbookConvertKepubify - test_convert_wrong_excecutable	PASS
TestEbookConvertGDriveKepubify	3	3	0	0	0	Detail
TestEbookConvertGDriveKepubify - test_convert_deactivate	PASS
TestEbookConvertGDriveKepubify - test_convert_only	PASS
TestEbookConvertGDriveKepubify - test_convert_wrong_excecutable	PASS
TestEditAdditionalBooks	13	12	0	0	1	Detail
TestEditAdditionalBooks - test_change_upload_formats	PASS
TestEditAdditionalBooks - test_delete_book	PASS
TestEditAdditionalBooks - test_delete_role	PASS
TestEditAdditionalBooks - test_edit_book_identifier	PASS
TestEditAdditionalBooks - test_edit_book_identifier_capital	PASS
TestEditAdditionalBooks - test_edit_book_identifier_standard	PASS
TestEditAdditionalBooks - test_edit_special_book_identifier	PASS
TestEditAdditionalBooks - test_title_sort	PASS
TestEditAdditionalBooks - test_upload_edit_role	PASS
TestEditAdditionalBooks - test_upload_metadata_cbr	PASS
TestEditAdditionalBooks - test_upload_metadata_cbt	PASS
TestEditAdditionalBooks - test_writeonly_calibre_database	SKIP Not implemented
TestEditAdditionalBooks - test_writeonly_path	PASS
TestEditBooks	33	26	5	0	2	Detail
TestEditBooks - test_download_book	PASS
TestEditBooks - test_edit_author	PASS
TestEditBooks - test_edit_category	PASS
TestEditBooks - test_edit_comments	PASS
TestEditBooks - test_edit_custom_bool	PASS
TestEditBooks - test_edit_custom_categories	PASS
TestEditBooks - test_edit_custom_float	FAIL Traceback (most recent call last): File "/home/ozzie/Development/calibre-web-test/test/test_edit_books.py", line 527, in test_edit_custom_float self.assertEqual(len(self.adv_search({u'custom_column_8': u'-2.5'})), 1) AssertionError: 0 != 1
TestEditBooks - test_edit_custom_int	FAIL Traceback (most recent call last): File "/home/ozzie/Development/calibre-web-test/test/test_edit_books.py", line 548, in test_edit_custom_int self.assertEqual(0, len(vals['cust_columns'])) AssertionError: 0 != 1
TestEditBooks - test_edit_custom_rating	FAIL Traceback (most recent call last): File "/home/ozzie/Development/calibre-web-test/test/test_edit_books.py", line 467, in test_edit_custom_rating self.assertEqual(0, len(vals['cust_columns'])) AssertionError: 0 != 1
TestEditBooks - test_edit_custom_single_select	FAIL Traceback (most recent call last): File "/home/ozzie/Development/calibre-web-test/test/test_edit_books.py", line 475, in test_edit_custom_single_select self.assertEqual(u'人物', vals['cust_columns'][0]['value']) AssertionError: '人物' != '-2.5' - 人物 + -2.5
TestEditBooks - test_edit_custom_text	FAIL Traceback (most recent call last): File "/home/ozzie/Development/calibre-web-test/test/test_edit_books.py", line 491, in test_edit_custom_text self.assertEqual(u'Lulu 人 Ä', vals['cust_columns'][0]['value']) AssertionError: 'Lulu 人 Ä' != '-2.5' - Lulu 人 Ä + -2.5
TestEditBooks - test_edit_language	PASS
TestEditBooks - test_edit_publisher	PASS
TestEditBooks - test_edit_publishing_date	SKIP Not Implemented
TestEditBooks - test_edit_rating	PASS
TestEditBooks - test_edit_series	PASS
TestEditBooks - test_edit_title	PASS
TestEditBooks - test_rename_uppercase_lowercase	SKIP Not Implemented
TestEditBooks - test_typeahead_author	PASS
TestEditBooks - test_typeahead_functions	PASS
TestEditBooks - test_typeahead_language	PASS
TestEditBooks - test_typeahead_publisher	PASS
TestEditBooks - test_typeahead_series	PASS
TestEditBooks - test_typeahead_tag	PASS
TestEditBooks - test_upload_book_cbr	PASS
TestEditBooks - test_upload_book_cbt	PASS
TestEditBooks - test_upload_book_cbz	PASS
TestEditBooks - test_upload_book_epub	PASS
TestEditBooks - test_upload_book_fb2	PASS
TestEditBooks - test_upload_book_lit	PASS
TestEditBooks - test_upload_book_mobi	PASS
TestEditBooks - test_upload_book_pdf	PASS
TestEditBooks - test_upload_cover_hdd	PASS
TestEditBooksList	3	3	0	0	0	Detail
TestEditBooksList - test_edit_books_list	PASS
TestEditBooksList - test_list_visibility	PASS
TestEditBooksList - test_merge_book	PASS
TestEditBooksOnGdrive	20	20	0	0	0	Detail
TestEditBooksOnGdrive - test_download_book	PASS
TestEditBooksOnGdrive - test_edit_author	PASS
TestEditBooksOnGdrive - test_edit_category	PASS
TestEditBooksOnGdrive - test_edit_comments	PASS
TestEditBooksOnGdrive - test_edit_custom_bool	PASS
TestEditBooksOnGdrive - test_edit_custom_categories	PASS
TestEditBooksOnGdrive - test_edit_custom_float	PASS
TestEditBooksOnGdrive - test_edit_custom_int	PASS
TestEditBooksOnGdrive - test_edit_custom_rating	PASS
TestEditBooksOnGdrive - test_edit_custom_single_select	PASS
TestEditBooksOnGdrive - test_edit_custom_text	PASS
TestEditBooksOnGdrive - test_edit_language	PASS
TestEditBooksOnGdrive - test_edit_publisher	PASS
TestEditBooksOnGdrive - test_edit_rating	PASS
TestEditBooksOnGdrive - test_edit_series	PASS
TestEditBooksOnGdrive - test_edit_title	PASS
TestEditBooksOnGdrive - test_upload_book_epub	PASS
TestEditBooksOnGdrive - test_upload_book_lit	PASS
TestEditBooksOnGdrive - test_upload_cover_hdd	PASS
TestEditBooksOnGdrive - test_watch_metadata	PASS
TestSTARTTLS	3	3	0	0	0	Detail
TestSTARTTLS - test_STARTTLS	PASS
TestSTARTTLS - test_STARTTLS_SSL_setup_error	PASS
TestSTARTTLS - test_STARTTLS_resend_password	PASS
TestSSL	5	5	0	0	0	Detail
TestSSL - test_SSL_None_setup_error	PASS
TestSSL - test_SSL_STARTTLS_setup_error	PASS
TestSSL - test_SSL_logging_email	PASS
TestSSL - test_SSL_only	PASS
TestSSL - test_email_limit	PASS
TestFilePicker	3	3	0	0	0	Detail
TestFilePicker - test_filepicker_all_file	PASS
TestFilePicker - test_filepicker_limited_file	PASS
TestFilePicker - test_filepicker_new_file	PASS
TestSetupGdrive	1	1	0	0	0	Detail
TestSetupGdrive - test_config_gdrive	PASS
TestGoodreads	3	3	0	0	0	Detail
TestGoodreads - test_author_page	PASS
TestGoodreads - test_author_page_invalid	PASS
TestGoodreads - test_goodreads_about	PASS
TestKoboSync	9	8	0	1	0	Detail
TestKoboSync - test_book_download	ERROR Traceback (most recent call last): File "/home/ozzie/Development/calibre-web-test/test/test_kobo_sync.py", line 585, in test_book_download data = self.inital_sync() File "/home/ozzie/Development/calibre-web-test/test/test_kobo_sync.py", line 133, in inital_sync self.assertEqual(data[3]['NewEntitlement']['BookMetadata']['DownloadUrls'][1]['Format'], 'EPUB') IndexError: list index out of range
TestKoboSync - test_kobo_about	PASS
TestKoboSync - test_shelves_add_remove_books	PASS
TestKoboSync - test_sync_changed_book	PASS
TestKoboSync - test_sync_invalid	PASS
TestKoboSync - test_sync_reading_state	PASS
TestKoboSync - test_sync_shelf	PASS
TestKoboSync - test_sync_unchanged	PASS
TestKoboSync - test_sync_upload	PASS
TestLdapLogin	13	13	0	0	0	Detail
TestLdapLogin - test_LDAP_SSL	PASS
TestLdapLogin - test_LDAP_SSL_CERTIFICATE	PASS
TestLdapLogin - test_LDAP_STARTTLS	PASS
TestLdapLogin - test_LDAP_fallback_Login	PASS
TestLdapLogin - test_LDAP_import	PASS
TestLdapLogin - test_LDAP_import_memberfield	PASS
TestLdapLogin - test_LDAP_login	PASS
TestLdapLogin - test_invalid_LDAP	PASS
TestLdapLogin - test_ldap_about	PASS
TestLdapLogin - test_ldap_authentication	PASS
TestLdapLogin - test_ldap_kobo_sync	PASS
TestLdapLogin - test_ldap_opds_anonymous	PASS
TestLdapLogin - test_ldap_opds_download_book	PASS
TestLogging	7	6	0	0	1	Detail
TestLogging - test_access_log_recover	PASS
TestLogging - test_debug_log	PASS
TestLogging - test_failed_login	PASS
TestLogging - test_failed_register	SKIP Not Implemented
TestLogging - test_logfile_change	PASS
TestLogging - test_logfile_recover	PASS
TestLogging - test_logviewer	PASS
TestLogin	14	14	0	0	0	Detail
TestLogin - test_digest_login	PASS
TestLogin - test_login_capital_letters_user_unicode_password	PASS
TestLogin - test_login_delete_admin	PASS
TestLogin - test_login_empty_password	PASS
TestLogin - test_login_locale_select	PASS
TestLogin - test_login_protected	PASS
TestLogin - test_login_remember_me	PASS
TestLogin - test_login_rename_user	PASS
TestLogin - test_login_unicode_user_space_end_password	PASS
TestLogin - test_login_user_with_space_password_end_space	PASS
TestLogin - test_magic_remote_login	PASS
TestLogin - test_next	PASS
TestLogin - test_proxy_login	PASS
TestLogin - test_robots	PASS
TestOAuthLogin	2	2	0	0	0	Detail
TestOAuthLogin - test_oauth_about	PASS
TestOAuthLogin - test_visible_oauth	PASS
TestOPDSFeed	21	21	0	0	0	Detail
TestOPDSFeed - test_opds	PASS
TestOPDSFeed - test_opds_author	PASS
TestOPDSFeed - test_opds_calibre_companion	PASS
TestOPDSFeed - test_opds_cover	PASS
TestOPDSFeed - test_opds_download_book	PASS
TestOPDSFeed - test_opds_formats	PASS
TestOPDSFeed - test_opds_guest_user	PASS
TestOPDSFeed - test_opds_hot	PASS
TestOPDSFeed - test_opds_language	PASS
TestOPDSFeed - test_opds_non_admin	PASS
TestOPDSFeed - test_opds_publisher	PASS
TestOPDSFeed - test_opds_random	PASS
TestOPDSFeed - test_opds_ratings	PASS
TestOPDSFeed - test_opds_read_unread	PASS
TestOPDSFeed - test_opds_search	PASS
TestOPDSFeed - test_opds_series	PASS
TestOPDSFeed - test_opds_shelf_access	PASS
TestOPDSFeed - test_opds_tags	PASS
TestOPDSFeed - test_opds_top_rated	PASS
TestOPDSFeed - test_opds_unicode_user	PASS
TestOPDSFeed - test_recently_added	PASS
TestUploadPDF	1	1	0	0	0	Detail
TestUploadPDF - test_upload_invalid_pdf	PASS
TestReader	5	5	0	0	0	Detail
TestReader - test_comic_reader	PASS
TestReader - test_epub_reader	PASS
TestReader - test_pdf_reader	PASS
TestReader - test_sound_listener	PASS
TestReader - test_txt_reader	PASS
TestRegister	8	8	0	0	0	Detail
TestRegister - test_forgot_password	PASS
TestRegister - test_illegal_email	PASS
TestRegister - test_limit_domain	PASS
TestRegister - test_register_no_server	PASS
TestRegister - test_registering_only_email	PASS
TestRegister - test_registering_user	PASS
TestRegister - test_registering_user_fail	PASS
TestRegister - test_user_change_password	PASS
TestShelf	11	10	0	0	1	Detail
TestShelf - test_add_shelf_from_search	PASS
TestShelf - test_arrange_shelf	PASS
TestShelf - test_delete_book_of_shelf	PASS
TestShelf - test_private_shelf	PASS
TestShelf - test_public_private_shelf	PASS
TestShelf - test_public_shelf	PASS
TestShelf - test_rename_shelf	PASS
TestShelf - test_shelf_action_non_shelf_edit_role	PASS
TestShelf - test_shelf_anonymous	PASS
TestShelf - test_shelf_database_change	SKIP Change Database Not Implemented
TestShelf - test_shelf_long_name	PASS
TestUpdater	8	7	0	0	1	Detail
TestUpdater - test_check_update_nightly_errors	PASS
TestUpdater - test_check_update_nightly_request_errors	PASS
TestUpdater - test_check_update_stable_errors	PASS
TestUpdater - test_check_update_stable_versions	PASS
TestUpdater - test_perform_update	PASS
TestUpdater - test_perform_update_stable_errors	PASS
TestUpdater - test_perform_update_timeout	SKIP Takes too long
TestUpdater - test_reconnect_database	PASS
TestUserLoad	1	1	0	0	0	Detail
TestUserLoad - test_user_change_vis	PASS
TestUserTemplate	21	21	0	0	0	Detail
TestUserTemplate - test_allow_column_restriction	PASS
TestUserTemplate - test_allow_tag_restriction	PASS
TestUserTemplate - test_archived_format_template	PASS
TestUserTemplate - test_author_user_template	PASS
TestUserTemplate - test_best_user_template	PASS
TestUserTemplate - test_category_user_template	PASS
TestUserTemplate - test_deny_column_restriction	PASS
TestUserTemplate - test_deny_tag_restriction	PASS
TestUserTemplate - test_detail_random_user_template	PASS
TestUserTemplate - test_download_user_template	PASS
TestUserTemplate - test_format_user_template	PASS
TestUserTemplate - test_hot_user_template	PASS
TestUserTemplate - test_language_user_template	PASS
TestUserTemplate - test_limit_book_languages	PASS
TestUserTemplate - test_list_user_template	PASS
TestUserTemplate - test_publisher_user_template	PASS
TestUserTemplate - test_random_user_template	PASS
TestUserTemplate - test_read_user_template	PASS
TestUserTemplate - test_recent_user_template	PASS
TestUserTemplate - test_series_user_template	PASS
TestUserTemplate - test_ui_language_settings	PASS
TestCalibreWebVisibilitys	33	33	0	0	0	Detail
TestCalibreWebVisibilitys - test_about	PASS
TestCalibreWebVisibilitys - test_admin_SMTP_Settings	PASS
TestCalibreWebVisibilitys - test_admin_add_user	PASS
TestCalibreWebVisibilitys - test_admin_change_password	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_archived	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_authors	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_category	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_file_formats	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_hot	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_language	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_publisher	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_random	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_rated	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_rating	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_read	PASS
TestCalibreWebVisibilitys - test_admin_change_visibility_series	PASS
TestCalibreWebVisibilitys - test_allow_columns	PASS
TestCalibreWebVisibilitys - test_allow_tags	PASS
TestCalibreWebVisibilitys - test_archive_books	PASS
TestCalibreWebVisibilitys - test_authors_max_settings	PASS
TestCalibreWebVisibilitys - test_change_title	PASS
TestCalibreWebVisibilitys - test_checked_logged_in	PASS
TestCalibreWebVisibilitys - test_hide_custom_column	PASS
TestCalibreWebVisibilitys - test_link_column_to_read_status	PASS
TestCalibreWebVisibilitys - test_random_books_available	PASS
TestCalibreWebVisibilitys - test_restrict_columns	PASS
TestCalibreWebVisibilitys - test_restrict_tags	PASS
TestCalibreWebVisibilitys - test_save_views_recent	PASS
TestCalibreWebVisibilitys - test_search_functions	PASS
TestCalibreWebVisibilitys - test_search_order	PASS
TestCalibreWebVisibilitys - test_search_string	PASS
TestCalibreWebVisibilitys - test_user_email_available	PASS
TestCalibreWebVisibilitys - test_user_visibility_sidebar	PASS
TestCalibreHelper	16	16	0	0	0	Detail
TestCalibreHelper - test_author_sort	PASS
TestCalibreHelper - test_author_sort_comma	PASS
TestCalibreHelper - test_author_sort_junior	PASS
TestCalibreHelper - test_author_sort_oneword	PASS
TestCalibreHelper - test_author_sort_roman	PASS
TestCalibreHelper - test_check_Limit_Length	PASS
TestCalibreHelper - test_check_char_replacement	PASS
TestCalibreHelper - test_check_chinese_Characters	PASS
TestCalibreHelper - test_check_deg_eur_replacement	PASS
TestCalibreHelper - test_check_doubleS	PASS
TestCalibreHelper - test_check_finish_Dot	PASS
TestCalibreHelper - test_check_high23	PASS
TestCalibreHelper - test_check_umlauts	PASS
TestCalibreHelper - test_random_password	PASS
TestCalibreHelper - test_split_authors	PASS
TestCalibreHelper - test_whitespaces	PASS
Total	300	287	5	1	7