#big-query — Public Fediverse posts

GitHub стал однообразнее после появления ChatGPT?

После появления ChatGPT и массового распространения GitHub Copilot, Cursor, Claude Code, Windsurf и других AI-инструментов разработка стала заметно быстрее. Код, тесты, README, комментарии и небольшие utility-функции теперь можно получить за секунды. Но вместе с этим появился менее очевидный вопрос: если миллионы разработчиков используют похожие модели и похожие промпты, не становится ли открытый код более однообразным? В этой статье я проверяю эту гипотезу на данных GitHub за 2019-2025 годы: через GH Archive, BigQuery, commit messages, README, имена функций и собственный GitHub Uniformity Index. К исследованию

https://habr.com/ru/articles/1055596/

#GitHub #open_source #ChatGPT #GitHub_Copilot #BigQuery #GH_Archive #LLM #анализ_данных #commit_messages #README

BigQuery Agent Analytics Plugin を使って ADK エージェントの回答を分析してみた
https://qiita.com/hirataikue/items/03654fdb3f0ff10d14f4?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #BigQuery #ADK #Gemini #GoogleCloud

Colleague said queries against our log data in BigQuery during the England Vs Ghana World Cup match last night were slow.

I thought that'd be due to us firing ~1.6 million log lines per second (~11Gb/s) into BigQuery almost constantly for 2 hours but actually it turned out that was fine (which is epic) & we simply hit the soft limit for BigQuery slots (2000 slots in Europe-West2).

Just requested a quota bump.

Found all of that in 10 mins via self-service metrics 👍🏻.

#BBC #WorldCup #BigQuery

Colleague said queries against our log data in BigQuery during the England Vs Ghana World Cup match last night were slow.

I thought that'd be due to us firing ~1.6 million log lines per second (~11Gb/s) into BigQuery almost constantly for 2 hours but actually it turned out that was fine (which is epic) & we simply hit the soft limit for BigQuery slots (2000 slots in Europe-West2).

Just requested a quota bump.

Found all of that in 10 mins via self-service metrics 👍🏻.

#BBC #WorldCup #BigQuery

Google Cloud、AIエージェント向け知識フォーマット「OKF」を発表──Markdown+YAMLで相互運用性を実現 — BigGo ファイナンス https://www.yayafa.com/2824024/ #AgenticAi #AI #Apache20 #ArtificialGeneralIntelligence #ArtificialIntelligence #BigQuery #DeepMind #Gemini #GitHub #Google #GoogleAI #GoogleCloud #GoogleDeepMind #GoogleGemini #KnowledgeCatalog #MCP（モデルコンテキストプロトコル） #Notion #Obsidian #OpenKnowledgeFormat（OKF） #RAG（検索拡張生成） #エージェント型AI #人工知能 #汎用人工知能

Google Cloud、AIエージェント向け知識フォーマット「OKF」を発表──Markdown+YAMLで相互運用性を実現 — BigGo ファイナンス https://www.yayafa.com/2824024/ #AgenticAi #AI #Apache20 #ArtificialGeneralIntelligence #ArtificialIntelligence #BigQuery #DeepMind #Gemini #GitHub #Google #GoogleAI #GoogleCloud #GoogleDeepMind #GoogleGemini #KnowledgeCatalog #MCP（モデルコンテキストプロトコル） #Notion #Obsidian #OpenKnowledgeFormat（OKF） #RAG（検索拡張生成） #エージェント型AI #人工知能 #汎用人工知能

My time series plot is beautiful like a Pink Floyd album.
Smaller is better. The latency values going down at week 21 are excellent news.
#BigQuery #SRE #darksideofthemoon

My time series plot is beautiful like a Pink Floyd album.
Smaller is better. The latency values going down at week 21 are excellent news.
#BigQuery #SRE #darksideofthemoon

📢⚠️🔑 Deleted Google API Keys remain active for up to 23 minutes after deletion, exposing GCP, Gemini, BigQuery, and Maps data to attackers.

Read: https://hackread.com/deleted-google-api-keys-active-23-minutes/

#CyberSecurity #Google #GoogleAPI #Gemini #BigQuery

📢⚠️🔑 Deleted Google API Keys remain active for up to 23 minutes after deletion, exposing GCP, Gemini, BigQuery, and Maps data to attackers.

Read: https://hackread.com/deleted-google-api-keys-active-23-minutes/

#CyberSecurity #Google #GoogleAPI #Gemini #BigQuery

One day at #Google Munich for the new services from Google.

Lot's of new stuff. But one thing that I see throughout the industry is that so many #aiagents examples don't require AI but are pure automation.

Also interesting to see that AI services can be called directly in #bigquery... But thinking about the #aiact and respective #governance, this means that a lot of applicants should appear in the company's ai register. 😕

Not a hot topic, but subject to more scanning of the query log. And.. Automation. Of course with an agent 😉

#googlecloudnext2026
#googlecloudnext

One day at #Google Munich for the new services from Google.

Lot's of new stuff. But one thing that I see throughout the industry is that so many #aiagents examples don't require AI but are pure automation.

Also interesting to see that AI services can be called directly in #bigquery... But thinking about the #aiact and respective #governance, this means that a lot of applicants should appear in the company's ai register. 😕

Not a hot topic, but subject to more scanning of the query log. And.. Automation. Of course with an agent 😉

#googlecloudnext2026
#googlecloudnext

Google Ads cuts granular data access to 37 months starting June 2026: Google Ads cuts granular reporting to 37 months from June 2026, reversing its 11-year policy and affecting the Google Ads API, scripts, and BigQuery pipelines. https://ppc.land/google-ads-cuts-granular-data-access-to-37-months-starting-june-2026/ #GoogleAds #DigitalMarketing #PPC #DataAccess #BigQuery

Google Ads cuts granular data access to 37 months starting June 2026: Google Ads cuts granular reporting to 37 months from June 2026, reversing its 11-year policy and affecting the Google Ads API, scripts, and BigQuery pipelines. https://ppc.land/google-ads-cuts-granular-data-access-to-37-months-starting-june-2026/ #GoogleAds #DigitalMarketing #PPC #DataAccess #BigQuery

I'm hiring an Analytics Engineer (GCP) to join my team at RHR International.
What you'd actually be doing: building and owning our analytics foundation in a Google Cloud GCP-first environment — BigQuery, Data/Looker Studio, Python, SQL, GitHub, Docker. Real production work, version-controlled and documented, not throwaway queries.
RHR is a leadership consulting firm that's been around for 80+ years. We're cloud-first, SaaS-only, no on-prem. Small IT team, which means your work matters immediately.
What I'm looking for beyond the technical skills: curiosity, self-direction, and the ability to explain what you built and why to people who don't write code. Bonus points if you've fixed something nobody asked you to fix.
Hybrid in Chicago preferred, remote considered.
Apply here: https://www.linkedin.com/jobs/view/4399748962/
If you know someone who fits, I'd appreciate the tag or share.

#Hiring
#AnalyticsEngineer
#GCP
#BigQuery
#DataEngineering
#Chicago
#RHRInternational
#Google
#GoogleCloud
#GoogleCloudPlatform

I'm hiring an Analytics Engineer (GCP) to join my team at RHR International.
What you'd actually be doing: building and owning our analytics foundation in a Google Cloud GCP-first environment — BigQuery, Data/Looker Studio, Python, SQL, GitHub, Docker. Real production work, version-controlled and documented, not throwaway queries.
RHR is a leadership consulting firm that's been around for 80+ years. We're cloud-first, SaaS-only, no on-prem. Small IT team, which means your work matters immediately.
What I'm looking for beyond the technical skills: curiosity, self-direction, and the ability to explain what you built and why to people who don't write code. Bonus points if you've fixed something nobody asked you to fix.
Hybrid in Chicago preferred, remote considered.
Apply here: https://www.linkedin.com/jobs/view/4399748962/
If you know someone who fits, I'd appreciate the tag or share.

#Hiring
#AnalyticsEngineer
#GCP
#BigQuery
#DataEngineering
#Chicago
#RHRInternational
#Google
#GoogleCloud
#GoogleCloudPlatform

FYI: Data Studio is back: Google kills Looker Studio name for good: Google reversed its 2022 Looker Studio rebrand on April 11, 2026, restoring the Data Studio name and expanding the platform with BigQuery agents and Colab apps. https://ppc.land/data-studio-is-back-google-kills-looker-studio-name-for-good/ #DataStudio #Google #LookerStudio #BigQuery #Colab

ICYMI: Data Studio is back: Google kills Looker Studio name for good: Google reversed its 2022 Looker Studio rebrand on April 11, 2026, restoring the Data Studio name and expanding the platform with BigQuery agents and Colab apps. https://ppc.land/data-studio-is-back-google-kills-looker-studio-name-for-good/ #DataStudio #Google #LookerStudio #BigQuery #Colab

Data Studio is back: Google kills Looker Studio name for good: Google reversed its 2022 Looker Studio rebrand on April 11, 2026, restoring the Data Studio name and expanding the platform with BigQuery agents and Colab apps. https://ppc.land/data-studio-is-back-google-kills-looker-studio-name-for-good/ #DataStudio #Google #BigQuery #LookerStudio #DataAnalytics

Data Studio is back: Google kills Looker Studio name for good: Google reversed its 2022 Looker Studio rebrand on April 11, 2026, restoring the Data Studio name and expanding the platform with BigQuery agents and Colab apps. https://ppc.land/data-studio-is-back-google-kills-looker-studio-name-for-good/ #DataStudio #Google #BigQuery #LookerStudio #DataAnalytics

I'm hiring an Analytics Engineer (GCP) to join my team at RHR International, reporting directly to me.

What you'd actually be doing: building and owning our analytics foundation in a GCP-first environment — BigQuery, Looker Studio, Python, SQL, GitHub, Docker. Real production work, version-controlled and documented, not throwaway queries.

RHR is a leadership consulting firm that's been around 80+ years. We're cloud-first, SaaS-only, no on-prem. Small IT team, which means your work matters immediately.

What I'm looking for beyond the technical skills: curiosity, self-direction, and the ability to explain what you built and why to people who don't write code. Bonus points if you've fixed something nobody asked you to fix.

Hybrid in Chicago preferred, remote considered.

Link to apply: https://www.linkedin.com/jobs/view/4399748962/

If you know someone who fits, I'd appreciate the tag or share.

#Hiring #AnalyticsEngineer #GCP #BigQuery #DataEngineering #Chicago #RHRInternational #Google

I'm hiring an Analytics Engineer (GCP) to join my team at RHR International, reporting directly to me.

What you'd actually be doing: building and owning our analytics foundation in a GCP-first environment — BigQuery, Looker Studio, Python, SQL, GitHub, Docker. Real production work, version-controlled and documented, not throwaway queries.

RHR is a leadership consulting firm that's been around 80+ years. We're cloud-first, SaaS-only, no on-prem. Small IT team, which means your work matters immediately.

What I'm looking for beyond the technical skills: curiosity, self-direction, and the ability to explain what you built and why to people who don't write code. Bonus points if you've fixed something nobody asked you to fix.

Hybrid in Chicago preferred, remote considered.

Link to apply: https://www.linkedin.com/jobs/view/4399748962/

If you know someone who fits, I'd appreciate the tag or share.

#Hiring #AnalyticsEngineer #GCP #BigQuery #DataEngineering #Chicago #RHRInternational #Google

geoparquet-io: Fast #GeoParquet tool: geoparquet-io is an open-source #CLI tool and #Python library for converting, inspecting, optimizing, and partitioning #GeoParquet files, automatically applying GeoParquet performance best practices along the way. Its extract command can pull geodata from sources such as #WFS, #Esri ArcGIS Feature Services, or #BigQuery into GeoParquet.
https://spatialists.ch/posts/2026/04/06-geoparquet-io-fast-geoparquet-tool/ #GIS #GISchat #geospatial #SwissGIS

geoparquet-io: Fast #GeoParquet tool: geoparquet-io is an open-source #CLI tool and #Python library for converting, inspecting, optimizing, and partitioning #GeoParquet files, automatically applying GeoParquet performance best practices along the way. Its extract command can pull geodata from sources such as #WFS, #Esri ArcGIS Feature Services, or #BigQuery into GeoParquet.
https://spatialists.ch/posts/2026/04/06-geoparquet-io-fast-geoparquet-tool/ #GIS #GISchat #geospatial #SwissGIS

Built an end-to-end data pipeline using GCP, Airflow, PySpark, and BigQuery to analyze thermal anomaly data (India 🇮🇳 vs USA 🇺🇸).
Uncovered patterns in fire frequency, intensity, and seasonality through interactive dashboards.
#DataEngineering #GCP #Airflow #BigQuery #PySpark

TCO или Полная Стоимость Владение современных подходов в ETL для DB MPP

О чем эта статья : В данной статье я хочу сравнить TCO старых добрых ETL как например Informatica, ODI, MarkitEDM и подобных им vs DBT + AirFlow и подобных им Очень легко проанализировать стоимость лицензий или вычислений и хранения в случае облачной БД, но очень сложно — TCO. Стоимость разработки одной фичи, стоимость поддержки, стоимость сопровождения, стоимость изменений. Очень заманчиво учитывать только расходы на лицензии и вычисления и предполагать, что все остальные расходы одинаковы, хотя это не так. По умолчанию облачные MPP-базы обычно дешевле по хранению и вычислениям и не имеют лицензионной платы, и возникает соблазн использовать такой же безлицензионный подход в ETL, но есть недостатки :

https://habr.com/ru/articles/1014362/

#mppбазы #informatica #dbt #etl #airflow #oracle #bigquery

Secretly convinced BigQuery's main use case is pulling pypi stats

#Python #BigQuery #pypi

Secretly convinced BigQuery's main use case is pulling pypi stats

#Python #BigQuery #pypi

Claude Code + BigQuery → agent analityczny, który pracuje na Twoich danych 24/7

Bez kopiowania zapytań. Bez pośredników. Bez przełączania między narzędziami.

To wszystko dzięki połączeniu Claude'a bezpośrednio do BigQuery przez MCP.

#iToSięLiczy
#AI #BigQuery #GoogleCloud #GA4 #DataDrivenMarketing #Automatyzacja #MarketingAnalytics

Claude Code + BigQuery → agent analityczny, który pracuje na Twoich danych 24/7

Bez kopiowania zapytań. Bez pośredników. Bez przełączania między narzędziami.

To wszystko dzięki połączeniu Claude'a bezpośrednio do BigQuery przez MCP.

#iToSięLiczy
#AI #BigQuery #GoogleCloud #GA4 #DataDrivenMarketing #Automatyzacja #MarketingAnalytics

BigQuery pipe syntax by example
by Antonella Blasetti

❤️❤️ Pipe syntax is so, so awesome! Seriously.

https://medium.com/google-cloud/bigquery-pipe-syntax-by-example-blasetta-0f3df50ba331

#BigQuery #SQL #GoogleCloud

BigQuery pipe syntax by example
by Antonella Blasetti

❤️❤️ Pipe syntax is so, so awesome! Seriously.

https://medium.com/google-cloud/bigquery-pipe-syntax-by-example-blasetta-0f3df50ba331

#BigQuery #SQL #GoogleCloud

🚀 The new LangChain GTM Agent can pull data straight from Salesforce and BigQuery, monitor funding rounds, product launches, and AI trends—all in an open‑source, automated workflow. Perfect for teams that need real‑time business intelligence without vendor lock‑in. Dive in to see how it streamlines data pipelines and boosts decision‑making. #LangChain #GTMAgent #Salesforce #BigQuery

🔗 https://aidailypost.com/news/langchain-gtm-agent-pulls-salesforce-bigquery-data-tracks-funding

🚀 The new LangChain GTM Agent can pull data straight from Salesforce and BigQuery, monitor funding rounds, product launches, and AI trends—all in an open‑source, automated workflow. Perfect for teams that need real‑time business intelligence without vendor lock‑in. Dive in to see how it streamlines data pipelines and boosts decision‑making. #LangChain #GTMAgent #Salesforce #BigQuery

🔗 https://aidailypost.com/news/langchain-gtm-agent-pulls-salesforce-bigquery-data-tracks-funding

【プログラミング入門】SQLの基本を解説！データベース操作の学ぼう！〜VTuberと学習〜【初心者向け】

https://www.emilyselect.com/%e3%80%90%e3%83%97%e3%83%ad%e3%82%b0%e3%83%a9%e3%83%9f%e3%83%b3%e3%82%b0%e5%85%a5%e9%96%80%e3%80%91sql%e3%81%ae%e5%9f%ba%e6%9c%ac%e3%82%92%e8%a7%a3%e8%aa%ac%ef%bc%81%e3%83%87%e3%83%bc%e3%82%bf/?feed_id=4498&_unique_id=69947f2bbebf6&Mastodon

#BigQuery #DB #RDB #SQL #エスキューエル #データベース #プログラミング #入門 #初心者 #基本 #学習 #DB・SQL基礎・入門 #DB・SQL基礎・入門 #BigQuery #DB #RDB #SQL #エスキューエル #データベース #プログラミング #入門 #初心者 #基本 #学習

【プログラミング入門】SQLの基本を解説！データベース操作の学ぼう！〜VTuberと学習〜【初心者向け】

https://www.emilyselect.com/%e3%80%90%e3%83%97%e3%83%ad%e3%82%b0%e3%83%a9%e3%83%9f%e3%83%b3%e3%82%b0%e5%85%a5%e9%96%80%e3%80%91sql%e3%81%ae%e5%9f%ba%e6%9c%ac%e3%82%92%e8%a7%a3%e8%aa%ac%ef%bc%81%e3%83%87%e3%83%bc%e3%82%bf/?feed_id=4498&_unique_id=69947f2bbebf6&Mastodon

#BigQuery #DB #RDB #SQL #エスキューエル #データベース #プログラミング #入門 #初心者 #基本 #学習 #DB・SQL基礎・入門 #DB・SQL基礎・入門 #BigQuery #DB #RDB #SQL #エスキューエル #データベース #プログラミング #入門 #初心者 #基本 #学習

RE: https://saptodon.org/@nextlytics/116028370585178197

Die Ausschreibung für Senior Data Scientist (gn) findet sich jetzt auch auf unserer Webseite!

https://www.nextlytics.com/de/karriere/jobs/senior-data-science-consultant-w/m/d

#fedihire #fedihire_de #fedijobs #fedijobs_de #datasciencejobs #datascience #databricks #snowflake #bigquery

RE: https://saptodon.org/@nextlytics/116028370585178197

Die Ausschreibung für Senior Data Scientist (gn) findet sich jetzt auch auf unserer Webseite!

https://www.nextlytics.com/de/karriere/jobs/senior-data-science-consultant-w/m/d

#fedihire #fedihire_de #fedijobs #fedijobs_de #datasciencejobs #datascience #databricks #snowflake #bigquery

Hi All! I started posting my data engineering learning journey and thought it would be great share here as well!

🚀 Week 3 of Data Engineering Zoomcamp by DataTalksClub complete! I'm really enjoying how hands on and practical the course is so far!

This week I focused on data warehousing with #Google #BigQuery. Coming from the world of #Microsoft Azure, it was a great experience to get familiar with BigQuery's serverless architecture and how it manages and processes big data at scale. Here's what I learned:

✅️ Created external tables from GCS bucket data sources (CSV/Parquet)
✅️ Use partitioning/clustering to save on cost & enhance speed of processing SQL queries
✅️ Used both #Docker & #Kestra to orchestrate the extraction, transfer, and loading 20+ million NYC taxi data at scale into a GCS bucket
✅️ Understand the advantages of columnar storage and query optimization

Check out my work here: https://github.com/ammartin8/data_engineering_zoom_camp/blob/main/modules/module_3/project_03/README.md

#googlecloud #dataengineering #microsoft #cloud #bigdata #dataanalytics #fedihire #linux #data

Hi All! I started posting my data engineering learning journey and thought it would be great share here as well!

🚀 Week 3 of Data Engineering Zoomcamp by DataTalksClub complete! I'm really enjoying how hands on and practical the course is so far!

This week I focused on data warehousing with #Google #BigQuery. Coming from the world of #Microsoft Azure, it was a great experience to get familiar with BigQuery's serverless architecture and how it manages and processes big data at scale. Here's what I learned:

✅️ Created external tables from GCS bucket data sources (CSV/Parquet)
✅️ Use partitioning/clustering to save on cost & enhance speed of processing SQL queries
✅️ Used both #Docker & #Kestra to orchestrate the extraction, transfer, and loading 20+ million NYC taxi data at scale into a GCS bucket
✅️ Understand the advantages of columnar storage and query optimization

Check out my work here: https://github.com/ammartin8/data_engineering_zoom_camp/blob/main/modules/module_3/project_03/README.md

#googlecloud #dataengineering #microsoft #cloud #bigdata #dataanalytics #fedihire #linux #data

Accidentally spent ~800$ in #bigquery last week in the span of about an hour. Coming from regular old SQL databases I never considered a query to "cost". Lesson learned.

Kind of insane how unsafe the UX is though.

Accidentally spent ~800$ in #bigquery last week in the span of about an hour. Coming from regular old SQL databases I never considered a query to "cost". Lesson learned.

Kind of insane how unsafe the UX is though.

Say hello to GoogleSQL

https://fed.brid.gy/r/https://nerds.xyz/2026/02/googlesql-zetasql-rename/

クレカ登録不要！Google Cloudの「BigQuery Sandbox」で日本の検索トレンドを無料で分析してみた
https://qiita.com/n-kawashima/items/3c796a64b8610b78cbd4?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #BigQuery #GoogleCloud

построение интеллектуальной системы вопросов и ответов и корпоративной базы знаний на базе StarRocks + DeepSeek

Типовые сценарии на базе StarRocks + DeepSeek. DeepSeek: генерация качественных эмбеддингов и ответов, StarRocks: высокоэффективный векторный поиск и хранение.Вместе они образуют основу для точных и масштабируемых AI‑решений.

https://habr.com/ru/articles/980410/

#starrocks #deepseek #vector_index #rag #bigdata #bigquery

https://winbuzzer.com/2025/12/11/google-launches-managed-mcp-servers-integrating-agentic-ai-with-enterprise-security-xcxwbn/

Google Launches Managed MCP Servers, Integrating Agentic AI with Enterprise Security

#AI #GoogleCloud #MCP #AgenticAI #BigQuery #GoogleMaps #APIs #CloudComputing