Skip to content

Generative AI 2025 queries#4302

Merged
tunetheweb merged 15 commits intomainfrom
generative-ai-sql
Jan 9, 2026
Merged

Generative AI 2025 queries#4302
tunetheweb merged 15 commits intomainfrom
generative-ai-sql

Conversation

@christianliebel
Copy link
Copy Markdown
Member

@christianliebel christianliebel commented Dec 29, 2025

Makes progress on #4104

This SQL query calculates the percentage of sites using CSS gradients over specific years, grouped by client and rank.
This SQL query calculates the percentage of sites with a valid robots.txt file, including various directives, based on data from the HTTP Archive crawl.
This SQL script calculates the percentage of sites mentioning a specific user-agent in their robots.txt file, categorized by rank bucket. Inspired by https://paulcalvano.com/2025-08-21-ai-bots-and-robots-txt/
This SQL query analyzes the adoption of CSS gradients by clients over specific years, grouping results by rank and calculating the percentage of sites using gradients.
@christianliebel christianliebel changed the title Generative AI 2025 Queries Generative AI 2025 queries Dec 29, 2025
@christianliebel christianliebel added the analysis Querying the dataset label Dec 29, 2025
Copy link
Copy Markdown
Member

@tunetheweb tunetheweb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but suggesting some formatting improvements

Comment thread sql/2025/generative-ai/ai_tld.sql Outdated
Comment thread sql/2025/generative-ai/gradient-client-rank.sql Outdated
Comment thread sql/2025/generative-ai/gradient-use.sql Outdated
Comment thread sql/2025/generative-ai/gradient.sql Outdated
Comment thread sql/2025/generative-ai/sites-with-robot-txt.sql Outdated
Comment thread sql/2025/generative-ai/user-agent-years.sql Outdated
Comment thread sql/2025/generative-ai/user-agent-years.sql Outdated
Comment thread sql/2025/generative-ai/user-agent-years.sql Outdated
Comment thread sql/2025/generative-ai/user-agent-years.sql Outdated
Comment thread sql/2025/generative-ai/vibecodetools.sql
@christianliebel
Copy link
Copy Markdown
Member Author

christianliebel commented Dec 29, 2025

@jcmpagel Could you have a look at @tunetheweb's suggestions?

Copy link
Copy Markdown
Member

@tunetheweb tunetheweb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lots of comments, but most are editorial nits. Once we fix those I think this is good to merge!

@tunetheweb
Copy link
Copy Markdown
Member

Lots of comments, but most are editorial nits. Once we fix those I think this is good to merge!

Ignore - wrong PR!!

Comment thread sql/2025/generative-ai/vibecodetools.sql Outdated
Comment thread sql/2025/generative-ai/gradient-client-rank.sql Outdated
@tunetheweb tunetheweb merged commit f2f949c into main Jan 9, 2026
5 checks passed
@tunetheweb tunetheweb deleted the generative-ai-sql branch January 9, 2026 11:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

analysis Querying the dataset

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants