Skip to content

Task/add headline data to public api ingestion/cdd 3359#3261

Open
phill-stanley wants to merge 3 commits into
mainfrom
task/add-headline-data-to-public-api-ingestion/cdd-3359
Open

Task/add headline data to public api ingestion/cdd 3359#3261
phill-stanley wants to merge 3 commits into
mainfrom
task/add-headline-data-to-public-api-ingestion/cdd-3359

Conversation

@phill-stanley

@phill-stanley phill-stanley commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

Description

This PR includes the following:

  • Introduces an API Headline denormalised table for use with the public API
  • Updates to the ingestion pipeline to process headline data into both CoreHeadline and new APIHeadline table
  • Includes updates to clear_stale_headlines to remove duplicate entries in APIHeadline on ingestion

Fixes #CDD-3359


Type of change

Please select the options that are relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Tech debt item (this is focused solely on addressing any relevant technical debt)

Checklist:

  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have added tests at the right levels to prove my change is effective
  • I have added screenshots or screen grabs where appropriate
  • I have added docstrings in the correct style (google)

@phill-stanley phill-stanley requested a review from a team as a code owner June 24, 2026 22:24
@phill-stanley phill-stanley changed the title Task/add headline data to public api ingestion/cdd 3359 DRAFT: Task/add headline data to public api ingestion/cdd 3359 Jun 24, 2026
@phill-stanley phill-stanley force-pushed the task/add-headline-data-to-public-api-ingestion/cdd-3359 branch from dfd5c1d to d2c909f Compare June 25, 2026 10:54
@aidan aidan force-pushed the task/add-headline-data-to-public-api-ingestion/cdd-3359 branch from d2c909f to 9dfb7ac Compare June 26, 2026 10:44
@aidan aidan force-pushed the task/add-headline-data-to-public-api-ingestion/cdd-3359 branch 2 times, most recently from b4c7080 to 8709063 Compare June 26, 2026 14:14
@aidan aidan force-pushed the task/add-headline-data-to-public-api-ingestion/cdd-3359 branch from 8709063 to b0670f2 Compare June 26, 2026 14:32
@sonarqubecloud

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
5.0% Duplication on New Code (required ≤ 3%)

See analysis details on SonarQube Cloud

@aidan aidan changed the title DRAFT: Task/add headline data to public api ingestion/cdd 3359 Task/add headline data to public api ingestion/cdd 3359 Jun 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants