[AIRFLOW-6623] We are receiving the following errors in our scheduling pod

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.10.1
• Component/s: database
• Environment: Debian 4.9.168-1+deb9u3 (2019-06-16) x86_64 GNU/Linux
• Flags: Important
• Assignee: Unassigned
• Reporter: Ed S
• Created: 23/Jan/20 14:09
• Updated: 23/Jan/20 14:09

Description

Our AWS docker scheduling pod is failing repeatedly with the following message - started Tueday, we haven't made any changes/modifications/upgrade

 

sqlalchemy.exc.InternalError: (psycopg2.InternalError) failed to re-find parent key in index "idx_job_state_heartbeat" for split pages 7125/9116
[SQL: 'INSERT INTO job (dag_id, state, job_type, start_date, end_date, latest_heartbeat, executor_class, hostname, unixname) VALUES (%(dag_id)s, %(state)s, %(job_type)s, %(start_date)s, %(end_date)s, %(latest_heartbeat)s, %(executor_class)s, %(hostname)s, %(unixname)s) RETURNING job.id'] [parameters: {'dag_id': None, 'state': 'running', 'job_type': 'SchedulerJob', 'start_date': datetime.datetime(2020, 1, 23, 14, 5, 1, 985712, tzinfo=<Timezone [UTC]>), 'end_date': None, 'latest_heartbeat': datetime.datetime(2020, 1, 23, 14, 5, 1, 985721, tzinfo=<Timezone [UTC]>), 'executor_class': 'CeleryExecutor', 'hostname': 'airflow-scheduler-7f8d964898-ss24d', 'unixname': 'airflow'}]