Processing...

ID Type Status Progress Started Completed Duration
261 enrichment completed
0/0
2026-03-21 02:00 2026-03-21 02:00 0 min
260 monitoring running
0/2069
2026-03-21 01:00 - Running...
259 enrichment completed
0/0
2026-03-20 02:00 2026-03-20 02:00 0 min
258 monitoring running
0/1309
2026-03-20 01:00 - Running...
257 enrichment completed
0/0
2026-03-19 02:00 2026-03-19 02:00 0 min
256 monitoring running
0/2069
2026-03-19 01:00 - Running...
255 enrichment completed
0/0
2026-03-18 02:00 2026-03-18 02:00 0 min
254 monitoring running
0/2249
2026-03-18 01:00 - Running...
252 enrichment failed
0/0
2026-03-17 08:14 2026-03-17 08:19 5 min
Error: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 17, 8, 19, 7, 165792), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 952, in do_execute cursor.execute(statement, parameters) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute result = self._query(query) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query conn.query(q) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 575, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 826, in _read_query_result result.read() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 1203, in read first_packet = self.connection._read_packet() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 751, in _read_packet packet_header = self._read_bytes(4) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 805, in _read_bytes raise err.OperationalError( pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 288, in run_enrichment_job self.enrich_organisation(org) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 82, in enrich_organisation self._session.flush() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4331, in flush self._flush(objects) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4466, in _flush with util.safe_reraise(): File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 121, in __exit__ raise exc_value.with_traceback(exc_tb) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4427, in _flush flush_context.execute() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute rec.execute(self) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute util.preloaded.orm_persistence.save_obj( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 85, in save_obj _emit_update_statements( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 912, in _emit_update_statements c = connection.execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1419, in execute return meth( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 527, in _execute_on_connection return connection._execute_clauseelement( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1641, in _execute_clauseelement ret = self._execute_context( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context return self._exec_single_context( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context self._handle_dbapi_exception( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2363, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 952, in do_execute cursor.execute(statement, parameters) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute result = self._query(query) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query conn.query(q) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 575, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 826, in _read_query_result result.read() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 1203, in read first_packet = self.connection._read_packet() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 751, in _read_packet packet_header = self._read_bytes(4) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 805, in _read_bytes raise err.OperationalError( sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 17, 8, 19, 7, 165792), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 292, in run_enrichment_job logger.error("org_enrichment_failed", org_id=org.id, error=str(e)) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/attributes.py", line 569, in __get__ return self.impl.get(state, dict_) # type: ignore[no-any-return] File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/attributes.py", line 1096, in get value = self._fire_loader_callables(state, key, passive) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/attributes.py", line 1126, in _fire_loader_callables return state._load_expired(state, passive) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state.py", line 828, in _load_expired self.manager.expired_attribute_loader(self, toload, passive) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 1674, in load_scalar_attributes result = load_on_ident( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 510, in load_on_ident return load_on_pk_identity( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 695, in load_on_pk_identity session.execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2351, in execute return self._execute_internal( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal conn = self._connection_for_bind(bind) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind return trans._connection_for_bind(engine, execution_options) File "<string>", line 2, in _connection_for_bind File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 17, 8, 19, 7, 165792), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 189, in run_enrichment_task result_job = service.run_enrichment_job(only_without_enrichment=not force) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 318, in run_enrichment_job self._session.commit() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2030, in commit trans.commit(_to_root=True) File "<string>", line 2, in commit File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 17, 8, 19, 7, 165792), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 26, in wrapper task_func(session, job_id=job_id, **kwargs) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 204, in run_enrichment_task session.commit() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2030, in commit trans.commit(_to_root=True) File "<string>", line 2, in commit File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 17, 8, 19, 7, 165792), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a)
251 monitoring failed
0/1749
2026-03-15 01:00 2026-03-17 08:43 3343 min
Error: Marked as failed: stuck in running state
250 monitoring failed
0/2209
2026-03-14 01:00 2026-03-17 08:43 4783 min
Error: Marked as failed: stuck in running state
249 monitoring failed
0/2109
2026-03-13 01:00 2026-03-17 08:43 6223 min
Error: Marked as failed: stuck in running state
248 monitoring failed
0/1889
2026-03-12 01:00 2026-03-17 08:43 7663 min
Error: Marked as failed: stuck in running state
247 monitoring failed
0/2069
2026-03-11 01:00 2026-03-17 08:43 9103 min
Error: Marked as failed: stuck in running state
245 enrichment failed
0/0
2026-03-10 12:20 2026-03-10 12:21 1 min
Error: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa", "linkedin": "https://www.linkedin.com/company/abalone"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 12, 21, 45, 994854), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 952, in do_execute cursor.execute(statement, parameters) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute result = self._query(query) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query conn.query(q) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 575, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 826, in _read_query_result result.read() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 1203, in read first_packet = self.connection._read_packet() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 751, in _read_packet packet_header = self._read_bytes(4) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 805, in _read_bytes raise err.OperationalError( pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 280, in run_enrichment_job self.enrich_organisation(org) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 74, in enrich_organisation self._session.flush() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4331, in flush self._flush(objects) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4466, in _flush with util.safe_reraise(): File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 121, in __exit__ raise exc_value.with_traceback(exc_tb) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4427, in _flush flush_context.execute() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute rec.execute(self) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute util.preloaded.orm_persistence.save_obj( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 85, in save_obj _emit_update_statements( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 912, in _emit_update_statements c = connection.execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1419, in execute return meth( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 527, in _execute_on_connection return connection._execute_clauseelement( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1641, in _execute_clauseelement ret = self._execute_context( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context return self._exec_single_context( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context self._handle_dbapi_exception( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2363, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 952, in do_execute cursor.execute(statement, parameters) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute result = self._query(query) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query conn.query(q) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 575, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 826, in _read_query_result result.read() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 1203, in read first_packet = self.connection._read_packet() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 751, in _read_packet packet_header = self._read_bytes(4) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 805, in _read_bytes raise err.OperationalError( sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa", "linkedin": "https://www.linkedin.com/company/abalone"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 12, 21, 45, 994854), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 284, in run_enrichment_job logger.error("org_enrichment_failed", org_id=org.id, error=str(e)) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/attributes.py", line 569, in __get__ return self.impl.get(state, dict_) # type: ignore[no-any-return] File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/attributes.py", line 1096, in get value = self._fire_loader_callables(state, key, passive) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/attributes.py", line 1126, in _fire_loader_callables return state._load_expired(state, passive) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state.py", line 828, in _load_expired self.manager.expired_attribute_loader(self, toload, passive) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 1674, in load_scalar_attributes result = load_on_ident( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 510, in load_on_ident return load_on_pk_identity( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 695, in load_on_pk_identity session.execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2351, in execute return self._execute_internal( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal conn = self._connection_for_bind(bind) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind return trans._connection_for_bind(engine, execution_options) File "<string>", line 2, in _connection_for_bind File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa", "linkedin": "https://www.linkedin.com/company/abalone"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 12, 21, 45, 994854), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 189, in run_enrichment_task result_job = service.run_enrichment_job(only_without_enrichment=not force) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 310, in run_enrichment_job self._session.commit() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2030, in commit trans.commit(_to_root=True) File "<string>", line 2, in commit File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa", "linkedin": "https://www.linkedin.com/company/abalone"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 12, 21, 45, 994854), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 26, in wrapper task_func(session, job_id=job_id, **kwargs) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 204, in run_enrichment_task session.commit() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2030, in commit trans.commit(_to_root=True) File "<string>", line 2, in commit File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa", "linkedin": "https://www.linkedin.com/company/abalone"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 12, 21, 45, 994854), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a)
244 enrichment failed
0/0
2026-03-10 03:01 2026-03-10 03:02 1 min
Error: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 3, 2, 49, 929427), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a) Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 952, in do_execute cursor.execute(statement, parameters) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute result = self._query(query) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query conn.query(q) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 575, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 826, in _read_query_result result.read() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 1203, in read first_packet = self.connection._read_packet() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 751, in _read_packet packet_header = self._read_bytes(4) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 805, in _read_bytes raise err.OperationalError( pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 228, in run_single_org_enrichment_task results = service.enrich_organisation(org) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/enrichment/enrichment_service.py", line 74, in enrich_organisation self._session.flush() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4331, in flush self._flush(objects) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4466, in _flush with util.safe_reraise(): File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 121, in __exit__ raise exc_value.with_traceback(exc_tb) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 4427, in _flush flush_context.execute() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute rec.execute(self) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute util.preloaded.orm_persistence.save_obj( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 85, in save_obj _emit_update_statements( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 912, in _emit_update_statements c = connection.execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1419, in execute return meth( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 527, in _execute_on_connection return connection._execute_clauseelement( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1641, in _execute_clauseelement ret = self._execute_context( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context return self._exec_single_context( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context self._handle_dbapi_exception( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 2363, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 952, in do_execute cursor.execute(statement, parameters) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 153, in execute result = self._query(query) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/cursors.py", line 322, in _query conn.query(q) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 575, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 826, in _read_query_result result.read() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 1203, in read first_packet = self.connection._read_packet() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 751, in _read_packet packet_header = self._read_bytes(4) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/pymysql/connections.py", line 805, in _read_bytes raise err.OperationalError( sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 3, 2, 49, 929427), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 26, in wrapper task_func(session, job_id=job_id, **kwargs) File "/home/membersavi-associa/htdocs/associa.membersavi.com/src/web/background.py", line 261, in run_single_org_enrichment_task session.commit() File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2030, in commit trans.commit(_to_root=True) File "<string>", line 2, in commit File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/state_changes.py", line 101, in _go self._raise_for_prerequisite_state(fn.__name__, current_state) File "/home/membersavi-associa/htdocs/associa.membersavi.com/.venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 971, in _raise_for_prerequisite_state raise sa_exc.PendingRollbackError( sqlalchemy.exc.PendingRollbackError: This Session's transaction has been rolled back due to a previous exception during flush. To begin a new transaction with this Session, first issue Session.rollback(). Original exception was: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: UPDATE organisations SET social_media=%(social_media)s, last_enriched_at=%(last_enriched_at)s, updated_at=now() WHERE organisations.id = %(organisations_id)s] [parameters: {'social_media': '{"facebook": "https://www.facebook.com/abalone-farmers-association-of-south-africa"}', 'last_enriched_at': datetime.datetime(2026, 3, 10, 3, 2, 49, 929427), 'organisations_id': 589}] (Background on this error at: https://sqlalche.me/e/20/e3q8) (Background on this error at: https://sqlalche.me/e/20/7s2a)
243 enrichment completed
0/0
2026-03-10 02:00 2026-03-10 02:00 0 min
242 monitoring failed
0/1889
2026-03-10 01:00 2026-03-17 08:43 10543 min
Error: Marked as failed: stuck in running state
241 enrichment completed
0/0
2026-03-09 02:00 2026-03-09 02:00 0 min
240 monitoring failed
0/2049
2026-03-09 01:00 2026-03-17 08:43 11983 min
Error: Marked as failed: stuck in running state

Scheduled Jobs

Loading...