data-quality

2 articles
sort: new top best
clear filter
google229 microsoft182 facebook159 bug-bounty124 exploit123 apple121 rce88 xss79 writeup59 cve57 browser52 react44 docker43 malware43 open-source43 account-takeover42 aws39 ai-agents35 supply-chain34 node30 dos30 ctf28 oauth27 privilege-escalation25 postmessage23 cloud23 cloudflare22 sqli22 cache-poisoning21 ssrf20 wordpress20 lfi20 pentest19 automation19 tool19 reverse-engineering18 machine-learning18 phishing17 llm17 info-disclosure17 kubernetes16 race-condition15 rust15 idor15 code-generation15 cors15 access-control14 csrf14 websocket13 opinion13
0 7/10
Catching silent data loss using BigQuery's native ML and Write API
tutorial

A technical walkthrough of building a silent data loss detection system using BigQuery's native Storage Write API metadata and built-in ML anomaly detection (AI.DETECT_ANOMALIES), implemented as a dbt incremental model that monitors hundreds of tables without external infrastructure or custom ML training.

data-quality anomaly-detection bigquery storage-write-api ml-detection timeseries-analysis dbt monitoring pipeline-validation data-loss-detection
BigQuery Storage Write API WRITE_API_TIMELINE_BY_PROJECT AI.DETECT_ANOMALIES TimesFM Nordnet Pub/Sub dbt
robertsahlin.substack.com · boxer_shorts · 1 day ago · details · hn
0 5/10
Show HN: Generator SFT and DPO datasets for tool-calling LoRA fine-tuning
tool

DataForge is an open-source toolkit for generating deterministic synthetic datasets for LLM tool-calling fine-tuning, featuring 8,500+ lines of code with anti-template detection and quality gates. The accompanying NHA Epistemic Deliberations dataset provides 183 real multi-agent reasoning sessions from 3-7 different LLM providers with convergence measurement and adversarial challenges for training reasoning-focused models.

llm-fine-tuning synthetic-data-generation sft dpo lora tool-calling dataset open-source multi-agent-reasoning chain-of-thought rlhf preference-learning data-quality epistemic-reasoning
DataForge NotHumanAllowed Anthropic OpenAI Gemini DeepSeek Grok Qwen 7B PROMETHEUS CASSANDRA ATHENA Geth Consensus
nothumanallowed.com · senza1dio · 1 day ago · details · hn