← Back to All Reports
PARTIALLY PASSED (91%)
Job Name
chat_based_editor_prod
Pipeline ID
Job ID
#4399618
Branch
master
Commit
N/A
Executed At
2026-09-10T18:58:21.098196
20
Passed
2
Failed
0
Skipped

Test Results (22 tests)

test_cbe01_cbe_service_chains_sanity[chromium-caption]
passed
⏱️ Duration: 9.71s
test_cbe01_cbe_service_chains_sanity[chromium-linebreak]
passed
⏱️ Duration: 9.77s
test_cbe01_cbe_service_chains_sanity[chromium-music]
passed
⏱️ Duration: 10.57s
test_cbe01_cbe_service_chains_sanity[chromium-outro_values]
passed
⏱️ Duration: 10.55s
test_cbe01_cbe_service_chains_sanity[chromium-remove_scene]
passed
⏱️ Duration: 11.08s
test_cbe01_cbe_service_chains_sanity[chromium-text_color]
passed
⏱️ Duration: 10.62s
test_cbe01_cbe_service_chains_sanity[chromium-text_font]
passed
⏱️ Duration: 13.85s
test_cbe01_cbe_service_chains_sanity[chromium-logo]
passed
⏱️ Duration: 9.75s
test_cbe01_cbe_service_chains_sanity[chromium-text_position]
failed
⏱️ Duration: 69.21s
❌ Error:
self = <tests.test_chat_based_editor.TestChatBasedEditor object at 0x7f2de6b3ec50> login_page = <pages.login_page.LoginPage object at 0x7f2de6ad9ff0> autopilot_page = <pages.autopilot_page.AutopilotPage object at 0x7f2de5e16410> base_url = 'https://promo.com', prompt_key = 'text_position' @pytest.mark.skip_smoke @pytest.mark.parametrize("prompt_key", [ "caption", "linebreak", "music", "outro_values", "remove_scene", "text_color", "text_font", "logo", "text_position", "translation", "add_scene", "change_watermark", ]) def test_cbe01_cbe_service_chains_sanity( self, login_page, autopilot_page, base_url, prompt_key ): """ CBE01 CBE service chains sanity Login as AI user → open Planner → ensure AI posts exist → open 1st post → open CBE → send prompt → verify AI response → verify save enabled → verify discard popup → save video. """ login_page.login_directly(base_url, email_ai, get_password()) autopilot_page.go_to_planner(base_url) autopilot_page.ensure_ai_posts_exist() autopilot_page.open_ai_post(1) autopilot_page.open_cbe() autopilot_page.send_cbe_prompt_and_wait(CBE_PROMPTS[prompt_key]) # text_font / text_position are known to be slower on the backend to # apply and enable Save (documented flaky report in migration_log.md); # give them extra headroom instead of the default 30s. save_timeout = 60_000 if prompt_key in ("text_font", "text_position") else 30_000 > autopilot_page.verify_cbe_save_enabled(timeout=save_timeout) tests/test_chat_based_editor.py:85: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <pages.autopilot_page.AutopilotPage object at 0x7f2de5e16410> timeout = 60000 def verify_cbe_save_enabled(self, timeout: int = 30_000): """ V
📸 Failure Screenshot:
Test failure screenshot
test_cbe01_cbe_service_chains_sanity[chromium-translation]
failed
⏱️ Duration: 8.78s
❌ Error:
self = <tests.test_chat_based_editor.TestChatBasedEditor object at 0x7f2de6b3e9e0> login_page = <pages.login_page.LoginPage object at 0x7f2de43ffa90> autopilot_page = <pages.autopilot_page.AutopilotPage object at 0x7f2de446d300> base_url = 'https://promo.com', prompt_key = 'translation' @pytest.mark.skip_smoke @pytest.mark.parametrize("prompt_key", [ "caption", "linebreak", "music", "outro_values", "remove_scene", "text_color", "text_font", "logo", "text_position", "translation", "add_scene", "change_watermark", ]) def test_cbe01_cbe_service_chains_sanity( self, login_page, autopilot_page, base_url, prompt_key ): """ CBE01 CBE service chains sanity Login as AI user → open Planner → ensure AI posts exist → open 1st post → open CBE → send prompt → verify AI response → verify save enabled → verify discard popup → save video. """ login_page.login_directly(base_url, email_ai, get_password()) autopilot_page.go_to_planner(base_url) autopilot_page.ensure_ai_posts_exist() autopilot_page.open_ai_post(1) autopilot_page.open_cbe() > autopilot_page.send_cbe_prompt_and_wait(CBE_PROMPTS[prompt_key]) tests/test_chat_based_editor.py:80: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <pages.autopilot_page.AutopilotPage object at 0x7f2de446d300> prompt = 'Use a different language in each caption' def send_cbe_prompt_and_wait(self, prompt: str): """ Types a prompt in the chat input, sends it, then waits for the AI response and asserts no error message is shown. The CBE chat history persists on the post across sessions, so on a post that has already been through prior prompts (e.g. test_cbe01's chained parametrized runs against the same post) the panel can alrea
📸 Failure Screenshot:
Test failure screenshot
test_cbe01_cbe_service_chains_sanity[chromium-add_scene]
passed
⏱️ Duration: 12.59s
test_cbe01_cbe_service_chains_sanity[chromium-change_watermark]
passed
⏱️ Duration: 10.75s
test_cbe02_cbe_should_work_in_all_ratios[chromium-wide]
passed
⏱️ Duration: 11.49s
test_cbe02_cbe_should_work_in_all_ratios[chromium-vertical]
passed
⏱️ Duration: 12.33s
test_cbe03_replace_a_clip[chromium-stock_video]
passed
⏱️ Duration: 15.26s
test_cbe03_replace_a_clip[chromium-stock_photo]
passed
⏱️ Duration: 12.79s
test_cbe03_replace_a_clip[chromium-uploaded_video]
passed
⏱️ Duration: 14.48s
test_cbe03_replace_a_clip[chromium-uploaded_photo]
passed
⏱️ Duration: 14.54s
test_cbe04_upload_via_filestack_url[chromium-video]
passed
⏱️ Duration: 24.49s
test_cbe04_upload_via_filestack_url[chromium-photo]
passed
⏱️ Duration: 13.32s
test_cbe05_voice_changes_not_possible_for_non_narrated_videos[chromium]
passed
⏱️ Duration: 7.82s
test_cbe06_upload_via_filestack_facebook_page[chromium]
passed
⏱️ Duration: 21.00s