← Back to All Reports
PARTIALLY PASSED (86%)
Job Name
chat_based_editor_prod
Pipeline ID
Job ID
#4455772
Branch
master
Commit
N/A
Executed At
2026-10-18T00:15:25.483034
19
Passed
3
Failed
0
Skipped

Test Results (22 tests)

test_cbe01_cbe_service_chains_sanity[chromium-caption]
failed
⏱️ Duration: 56.06s
❌ Error:
self = <tests.test_chat_based_editor.TestChatBasedEditor object at 0x7f2d266dd960> login_page = <pages.login_page.LoginPage object at 0x7f2d266b4ee0> autopilot_page = <pages.autopilot_page.AutopilotPage object at 0x7f2d266b7cd0> base_url = 'https://promo.com', prompt_key = 'caption' @pytest.mark.skip_smoke @pytest.mark.parametrize("prompt_key", [ "caption", "linebreak", "music", "outro_values", "remove_scene", "text_color", "text_font", "logo", "text_position", "translation", "add_scene", "change_watermark", ]) def test_cbe01_cbe_service_chains_sanity( self, login_page, autopilot_page, base_url, prompt_key ): """ CBE01 CBE service chains sanity Login as AI user → open Planner → ensure AI posts exist → open 1st non-voice-over AI post that offers CBE → open CBE → send prompt → verify AI response → verify save enabled → verify discard popup → save video. """ login_page.login_directly(base_url, email_ai, get_password()) autopilot_page.go_to_planner(base_url) > autopilot_page.ensure_ai_posts_exist() tests/test_chat_based_editor.py:77: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ pages/autopilot_page.py:456: in ensure_ai_posts_exist self.click_generate_video_posts() pages/autopilot_page.py:473: in click_generate_video_posts btn.click() /usr/local/lib/python3.10/dist-packages/playwright/sync_api/_generated.py:17876: in click self._sync( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_locator.py:165: in click return await self._frame._click(self._selector, strict=True, **params) /usr/local/lib/python3.10/dist-packages/playwright/_impl/_frame.py:593: in _click await self._channel.send("click", self._timeout, locals_to_params(locals())) /usr/local/lib/python3.10/dist-packages/playwright/_impl/_connection.
📸 Failure Screenshot:
Test failure screenshot
test_cbe01_cbe_service_chains_sanity[chromium-linebreak]
failed
⏱️ Duration: 111.14s
❌ Error:
self = <tests.test_chat_based_editor.TestChatBasedEditor object at 0x7f2d266dd870> login_page = <pages.login_page.LoginPage object at 0x7f2d24915e70> autopilot_page = <pages.autopilot_page.AutopilotPage object at 0x7f2d24916a10> base_url = 'https://promo.com', prompt_key = 'linebreak' @pytest.mark.skip_smoke @pytest.mark.parametrize("prompt_key", [ "caption", "linebreak", "music", "outro_values", "remove_scene", "text_color", "text_font", "logo", "text_position", "translation", "add_scene", "change_watermark", ]) def test_cbe01_cbe_service_chains_sanity( self, login_page, autopilot_page, base_url, prompt_key ): """ CBE01 CBE service chains sanity Login as AI user → open Planner → ensure AI posts exist → open 1st non-voice-over AI post that offers CBE → open CBE → send prompt → verify AI response → verify save enabled → verify discard popup → save video. """ login_page.login_directly(base_url, email_ai, get_password()) autopilot_page.go_to_planner(base_url) > autopilot_page.ensure_ai_posts_exist() tests/test_chat_based_editor.py:77: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ pages/autopilot_page.py:457: in ensure_ai_posts_exist self.wait_for_posts_generated(timeout=360_000) pages/autopilot_page.py:545: in wait_for_posts_generated self.page.locator(self.PLANNER_AI_BADGE).first.wait_for( /usr/local/lib/python3.10/dist-packages/playwright/sync_api/_generated.py:20539: in wait_for self._sync( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_locator.py:748: in wait_for await self._frame.wait_for_selector( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_frame.py:394: in wait_for_selector await self._channel.send( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_connection.py:76: in
📸 Failure Screenshot:
Test failure screenshot
test_cbe01_cbe_service_chains_sanity[chromium-music]
failed
⏱️ Duration: 111.10s
❌ Error:
self = <tests.test_chat_based_editor.TestChatBasedEditor object at 0x7f2d266dd240> login_page = <pages.login_page.LoginPage object at 0x7f2d1efb19f0> autopilot_page = <pages.autopilot_page.AutopilotPage object at 0x7f2d1efb24a0> base_url = 'https://promo.com', prompt_key = 'music' @pytest.mark.skip_smoke @pytest.mark.parametrize("prompt_key", [ "caption", "linebreak", "music", "outro_values", "remove_scene", "text_color", "text_font", "logo", "text_position", "translation", "add_scene", "change_watermark", ]) def test_cbe01_cbe_service_chains_sanity( self, login_page, autopilot_page, base_url, prompt_key ): """ CBE01 CBE service chains sanity Login as AI user → open Planner → ensure AI posts exist → open 1st non-voice-over AI post that offers CBE → open CBE → send prompt → verify AI response → verify save enabled → verify discard popup → save video. """ login_page.login_directly(base_url, email_ai, get_password()) autopilot_page.go_to_planner(base_url) > autopilot_page.ensure_ai_posts_exist() tests/test_chat_based_editor.py:77: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ pages/autopilot_page.py:457: in ensure_ai_posts_exist self.wait_for_posts_generated(timeout=360_000) pages/autopilot_page.py:545: in wait_for_posts_generated self.page.locator(self.PLANNER_AI_BADGE).first.wait_for( /usr/local/lib/python3.10/dist-packages/playwright/sync_api/_generated.py:20539: in wait_for self._sync( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_locator.py:748: in wait_for await self._frame.wait_for_selector( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_frame.py:394: in wait_for_selector await self._channel.send( /usr/local/lib/python3.10/dist-packages/playwright/_impl/_connection.py:76: in send
📸 Failure Screenshot:
Test failure screenshot
test_cbe01_cbe_service_chains_sanity[chromium-outro_values]
passed
⏱️ Duration: 12.74s
test_cbe01_cbe_service_chains_sanity[chromium-remove_scene]
passed
⏱️ Duration: 12.26s
test_cbe01_cbe_service_chains_sanity[chromium-text_color]
passed
⏱️ Duration: 12.58s
test_cbe01_cbe_service_chains_sanity[chromium-text_font]
passed
⏱️ Duration: 11.71s
test_cbe01_cbe_service_chains_sanity[chromium-logo]
passed
⏱️ Duration: 13.33s
test_cbe01_cbe_service_chains_sanity[chromium-text_position]
passed
⏱️ Duration: 11.15s
test_cbe01_cbe_service_chains_sanity[chromium-translation]
passed
⏱️ Duration: 12.67s
test_cbe01_cbe_service_chains_sanity[chromium-add_scene]
passed
⏱️ Duration: 14.06s
test_cbe01_cbe_service_chains_sanity[chromium-change_watermark]
passed
⏱️ Duration: 12.72s
test_cbe02_cbe_should_work_in_all_ratios[chromium-wide]
passed
⏱️ Duration: 22.48s
test_cbe02_cbe_should_work_in_all_ratios[chromium-vertical]
passed
⏱️ Duration: 19.97s
test_cbe03_replace_a_clip[chromium-stock_video]
passed
⏱️ Duration: 14.89s
test_cbe03_replace_a_clip[chromium-stock_photo]
passed
⏱️ Duration: 23.76s
test_cbe03_replace_a_clip[chromium-uploaded_video]
passed
⏱️ Duration: 13.32s
test_cbe03_replace_a_clip[chromium-uploaded_photo]
passed
⏱️ Duration: 13.58s
test_cbe04_upload_via_filestack_url[chromium-video]
passed
⏱️ Duration: 26.89s
test_cbe04_upload_via_filestack_url[chromium-photo]
passed
⏱️ Duration: 15.42s
test_cbe05_voice_changes_not_possible_for_non_narrated_videos[chromium]
passed
⏱️ Duration: 11.01s
test_cbe06_upload_via_filestack_facebook_page[chromium]
passed
⏱️ Duration: 23.35s