Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
SemBench
/
SemBench
Public
Notifications
You must be signed in to change notification settings
Fork
22
Star
64
Code
Issues
3
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Jul 16, 2026
Merge pull request #28 from SemBench/docs/adopted-by-new-systems
Show description for c814e38
SolidLao
authored
c814e38
View commit details
Copy full SHA for c814e38
Browse repository at this point
Add compilation-based semantic operators paper (arXiv:2607.13407) to Adopted By list
SolidLao
committed
03f0c8c
View commit details
Copy full SHA for 03f0c8c
Browse repository at this point
Commits on Jul 2, 2026
Merge pull request #27 from SemBench/docs/adopted-by-new-systems
Show description for 9cb4f52
SolidLao
authored
9cb4f52
View commit details
Copy full SHA for 9cb4f52
Browse repository at this point
Add BlendSQL (arXiv:2606.31808) to Adopted By list
Show description for b9346b6
SolidLao
and
claude
committed
b9346b6
View commit details
Copy full SHA for b9346b6
Browse repository at this point
Commits on Jul 1, 2026
Merge pull request #26 from SemBench/docs/adopted-by-new-systems
Show description for 53d3564
SolidLao
authored
53d3564
View commit details
Copy full SHA for 53d3564
Browse repository at this point
Add CADENZA (SIGMOD 2027) to Adopted By list
SolidLao
committed
a3f8c12
View commit details
Copy full SHA for a3f8c12
Browse repository at this point
Commits on Jun 8, 2026
Merge pull request #25 from SemBench/docs/adopted-by-new-systems
Show description for c283a84
SolidLao
authored
c283a84
View commit details
Copy full SHA for c283a84
Browse repository at this point
Add PLOP, Semantic Histograms, and SemWeave to Adopted By; link BAS to SIGMOD 2026
SolidLao
committed
9b68e80
View commit details
Copy full SHA for 9b68e80
Browse repository at this point
Commits on May 23, 2026
Drop stale LOTUS Q11 entries from cascade-skipped scale factors
Show description for 1d9f7d1
SolidLao
committed
1d9f7d1
View commit details
Copy full SHA for 1d9f7d1
Browse repository at this point
Re-run ecomm Q11 for LOTUS and Palimpzest with image-aware inputs
Show description for a02f172
SolidLao
committed
a02f172
View commit details
Copy full SHA for a02f172
Browse repository at this point
Commits on May 22, 2026
Fix gdown calls for v6.0.0 compatibility
Show description for 6572a77
SolidLao
committed
6572a77
View commit details
Copy full SHA for 6572a77
Browse repository at this point
Commits on May 5, 2026
Merge pull request #22 from SemBench/azimmerer/fix-ecomm-lotus-q11-input
Show description for 9bc031f
andizimmerer
authored
9bc031f
View commit details
Copy full SHA for 9bc031f
Browse repository at this point
Commits on Apr 30, 2026
also add image column for Palimpzest
andizimmerer
committed
de4c59d
View commit details
Copy full SHA for de4c59d
Browse repository at this point
Add image data to input lotus e-comm q11
andizimmerer
committed
99d7989
View commit details
Copy full SHA for 99d7989
Browse repository at this point
Commits on Apr 28, 2026
Update README.md for new website deployment
SolidLao
authored
209e7a9
View commit details
Copy full SHA for 209e7a9
Browse repository at this point
Commits on Mar 22, 2026
Add ground truth file generation for ecomm and mmqa scenarios
Show description for cf08139
SolidLao
committed
cf08139
View commit details
Copy full SHA for cf08139
Browse repository at this point
Commits on Mar 20, 2026
Add Adopted By section to README and website
Show description for e5adc75
SolidLao
committed
e5adc75
View commit details
Copy full SHA for e5adc75
Browse repository at this point
Commits on Mar 16, 2026
Add per-system isolated environments using uv
Show description for 8a32b26
SolidLao
committed
8a32b26
View commit details
Copy full SHA for 8a32b26
Browse repository at this point
Add VLDB 2026 acceptance notice and modernize website design
Show description for 729fde2
SolidLao
committed
729fde2
View commit details
Copy full SHA for 729fde2
Browse repository at this point
Commits on Mar 4, 2026
Add Submit page, architecture diagram, and sticky navbar
Show description for b67c3ad
SolidLao
committed
b67c3ad
View commit details
Copy full SHA for b67c3ad
Browse repository at this point
Commits on Feb 24, 2026
Add dual MIT/Apache 2.0 license
SolidLao
committed
995738f
View commit details
Copy full SHA for 995738f
Browse repository at this point
Commits on Feb 9, 2026
Merge pull request #19 from SolidLao/fix/nl-query-corrections
Show description for da6383c
SolidLao
authored
da6383c
View commit details
Copy full SHA for da6383c
Browse repository at this point
Update q9.toml
SolidLao
authored
fed4935
View commit details
Copy full SHA for fed4935
Browse repository at this point
Update q7.toml
SolidLao
authored
5ff7e5a
View commit details
Copy full SHA for 5ff7e5a
Browse repository at this point
Update q11.toml
SolidLao
authored
d14d6de
View commit details
Copy full SHA for d14d6de
Browse repository at this point
Update q10.toml
SolidLao
authored
02fdd1b
View commit details
Copy full SHA for 02fdd1b
Browse repository at this point
Commits on Feb 6, 2026
Fix NL query issues: Cars Q3 inversion, Medical Q4 typo, missing Ecomm NL questions
Show description for 12d60c0
SolidLao
committed
12d60c0
View commit details
Copy full SHA for 12d60c0
Browse repository at this point
Commits on Feb 5, 2026
Add natural language queries for cars scenario and clean up README
SolidLao
committed
b9822f0
View commit details
Copy full SHA for b9822f0
Browse repository at this point
Commits on Feb 1, 2026
Replace table generators with table_brick_design_avg.py, add sum_var std dev method
Show description for 56777bd
SolidLao
committed
56777bd
View commit details
Copy full SHA for 56777bd
Browse repository at this point
Commits on Jan 30, 2026
Update README to replace medical with cars scenario and update metrics
SolidLao
committed
9eb9ff7
View commit details
Copy full SHA for 9eb9ff7
Browse repository at this point
Remove medical scenario, rename Animals to Wildlife, add cars query coverage
SolidLao
committed
a88f0bf
View commit details
Copy full SHA for a88f0bf
Browse repository at this point
Add cars repeat5 metrics for sf39344, sf78688, and sf157376
SolidLao
committed
ce76273
View commit details
Copy full SHA for ce76273
Browse repository at this point
Commits on Jan 28, 2026
Add scalability data, cars scenario, scale selector, and updated team image
Show description for 3b9720e
SolidLao
committed
3b9720e
View commit details
Copy full SHA for 3b9720e
Browse repository at this point
Add scalability repeat metrics for ecomm and mmqa scenarios
SolidLao
committed
44619b6
View commit details
Copy full SHA for 44619b6
Browse repository at this point
Add aggregate operator table generator and LaTeX output
SolidLao
committed
b8c31f4
View commit details
Copy full SHA for b8c31f4
Browse repository at this point
Previous
Next
You can’t perform that action at this time.
