Try our Chrome extension
Easily add the current web-page from your browser directly into your changedetection.io tool, more great features coming soon!
Chrome Webstore
Changedetection.io needs your support!
You can help us by supporting changedetection.io on these platforms;
- Rate us at AlternativeTo.net
- Star us on GitHub
- Follow us at Twitter/X
- G2 Software reviews
- Check us out on LinkedIn
- And tell your friends and colleagues :)
The more popular changedetection.io is, the more time we can dedicate to adding amazing features!
Many thanks :)
changedetection.io team
Not yet seconds ago
False
Not yet seconds ago
9 minutes ago
Pro-tip: Highlight text to add to ignore filters
Skip to content
Navigation Menu
Toggle navigation
Sign in
Appearance settings
* Platform
+ AI CODE CREATION
o GitHub Copilot Write better code with AI
o GitHub Spark Build and deploy intelligent apps
o GitHub Models Manage and compare prompts
o MCP Registry New Integrate external tools
+ DEVELOPER WORKFLOWS
o Actions Automate any workflow
o Codespaces Instant dev environments
o Issues Plan and track work
o Code Review Manage code changes
+ APPLICATION SECURITY
o GitHub Advanced Security Find and fix vulnerabilities
o Code security Secure your code as you build
o Secret protection Stop leaks before they start
+ EXPLORE
o Why GitHub
o Documentation
o Blog
o Changelog
o Marketplace
View all features
* Solutions
+ BY COMPANY SIZE
o Enterprises
o Small and medium teams
o Startups
o Nonprofits
+ BY USE CASE
o App Modernization
o DevSecOps
o DevOps
o CI/CD
o View all use cases
+ BY INDUSTRY
o Healthcare
o Financial services
o Manufacturing
o Government
o View all industries
View all solutions
* Resources
+ EXPLORE BY TOPIC
o AI
o Software Development
o DevOps
o Security
o View all topics
+ EXPLORE BY TYPE
o Customer stories
o Events & webinars
o Ebooks & reports
o Business insights
o GitHub Skills
+ SUPPORT & SERVICES
o Documentation
o Customer support
o Community forum
o Trust center
o Partners
* Open Source
+ COMMUNITY
o GitHub Sponsors Fund open source developers
+ PROGRAMS
o Security Lab
o Maintainer Community
o Accelerator
o Archive Program
+ REPOSITORIES
o Topics
o Trending
o Collections
* Enterprise
+ ENTERPRISE SOLUTIONS
o Enterprise platform AI-powered developer platform
+ AVAILABLE ADD-ONS
o GitHub Advanced Security Enterprise-grade security features
o Copilot for Business Enterprise-grade AI features
o Premium Support Enterprise-grade 24/7 support
* Pricing
Search or jump to...
Search code, repositories, users, issues, pull requests...
Search
Clear
Search syntax tips
Provide feedback
We read every piece of feedback, and take your input very seriously.
Include my email address so I can be contacted
Cancel Submit feedback
Saved searches
Use saved searches to filter your results more quickly
Name
Query
To see all available qualifiers, see our documentation.
Cancel Create saved search
Sign in
Sign up
Appearance settings
Resetting focus
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
{{ message }}
promptfoo / promptfoo Public
* Uh oh!
There was an error while loading. Please reload this page.
* Notifications You must be signed in to change notification settings
* Fork 816
* Star 9.4k
* Code
* Issues 111
* Pull requests 87
* Actions
* Projects 0
* Security
Uh oh!
There was an error while loading. Please reload this page.
* Insights
Additional navigation options
* Code
* Issues
* Pull requests
* Actions
* Projects
* Security
* Insights
Releases: promptfoo/promptfoo
Releases Tags
Releases · promptfoo/promptfoo
0.120.4
11 Dec 19:50
github-actions
0.120.4
16305c6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.120.4 Latest
Latest
0.120.4 (2025-12-11)
Features
* providers: add ElevenLabs provider integration (#6022) (8d54faa)
* providers: add GPT-5.2 model support (#6628) (b105980)
* providers: add OpenCode SDK provider (#6423) (ef8f227)
* providers: add streaming option for Vertex AI Model Armor support (#6614) (aebd268)
* redteam: complete OWASP Agentic AI T1-T15 threat mapping (#6458) (24e3c2b)
Bug Fixes
* ci: format CHANGELOG.md and improve release-please formatting step (#6610) (b89977c)
* deps: update anthropic packages (#6616) (645386b)
* providers: add numRequests tracking to all provider tokenUsage objects (#6612) (d35bf7c)
* providers: update HuggingFace to use new inference API endpoint (#6624) (57f118b)
* redteam: preserve BestOfNProvider config through database serialization (#6598) (92adeba)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.120.3
10 Dec 21:08
github-actions
0.120.3
a12c9f5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.120.3
0.120.3 (2025-12-10)
Features
* providers: add multi-turn session persistence to browser provider (#6585) (873241e)
Bug Fixes
* build: exclude Nunjucks template fixture from TypeScript (#6588) (6f02eec)
* ci: resolve release workflow and devcontainer build failures (#6589) (707ace0)
* deps: update dependency @anthropic-ai/sdk to ^0.71.1 (#6594) (f11a097)
* deps: update dependency @modelcontextprotocol/sdk to v1.24.3 (#6590) (1bc4d27)
* deps: update dependency drizzle-orm to ^0.45.0 (#6592) (1bac327)
* deps: update winston to v3.19.0 and simplify logger flush (#6593) (f29926c)
* esm: restore process.mainModule.require compatibility for inline transforms (#6606) (765a26f)
* npm: drop npm version requirement (#6604) (a182bb2)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.120.2
09 Dec 14:14
github-actions
0.120.2
00a792b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.120.2
0.120.2 (2025-12-09)
Features
* assertions: tool calling f1 score (#6548) (1327195)
* providers: add Amazon Nova 2 model support with reasoning capabilities (#6531) (3a99c2b)
* providers: add Llama 3.2 Vision support for Bedrock InvokeModel API (#6555) (9b78f61)
* redteam: add job persistence for browser-based evaluations (#6529) (35f2e9f)
* redteam: Adding authentication options for HTTP provider (#6515) (df90497)
* tracing: add protobuf support for OTLP trace ingestion (#6540) (d83837e)
Bug Fixes
* assertions: filter preamble text in context-recall parser (#6566) (01e5bf0)
* assertions: improve is-sql error messages for whitelist violations (#6565) (43bd7d6)
* ci: rename GitHub releases to remove v prefix (#6574) (16a31eb)
* cli: show CLI UI during model scan by using temp file for JSON output (#6524) (f50456b)
* fix parsing empty contents for gemini providers (#6580) (ddff9b9)
* making guardrails fall back to false when undefined to simplify configuring successful responses (#6582) (ee698e4)
* redteam: fix prompt-injection strategy data.json loading in ESM build (#6583) (ae373dc)
* updating guardrail detection for vertex provider (#6581) (3c10f64)
* webui: add missing vitest imports to test files (#6577) (8c2afa0)
* webui: display provider errors in eval results fail reason carousel (#6552) (b43f225)
* webui: handle object outputs in eval prompt dialog (#6556) (c2a3441)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
v0.120.1
08 Dec 20:35
github-actions
0.120.1
8503fed
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
v0.120.1
0.120.1 (2025-12-08)
Features
* providers: update claude-agent-sdk to ^0.1.60 with betas and dontAsk support (#6557) (cc3d857)
Bug Fixes
* ci: trigger Docker build from release-please workflow (#6572) (6b17908)
* improved differentiation between parsing json and non-json chat messages (#6568) (3776606)
* use correct drizzle migrations path for npm/npx installs (#6573) (3e4fa81)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.120.0
08 Dec 19:34
github-actions
0.120.0
c0b47e4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.120.0
0.120.0 (2025-12-08)
Features
* build: migrate to ESM (ECMAScript Modules) (#5594) (9cdf09b)
* cli: toggle debug log live (#6517) (6beebce)
* providers: add Gemini native image generation support (#6405) (13bc040)
* redteam: add multi-modal layer strategy support for audio/image attacks (#6472) (c0d7c1c)
Bug Fixes
* build: add CommonJS fallback for .js files in ESM environment (#6501) (ae39641)
* build: fix require() module resolution (#6468) (ea6b299)
* build: migrate require() to ESM-compatible imports (#6509) (7b30dda)
* build: use npm environment variables for version detection (#6479) (2a88aab)
* assertions: allow Nunjucks templates in JSON rubricPrompt files (#6554) (7cdb1af)
* assertions: resolve provider paths relative to config file location (#6503) (61a77eb)
* cache: fix initialization (#6467) (df2ae94)
* cli: await modelaudit subprocess completion in scan-model command (#6518) (fe19331)
* cli: resolve view command premature exit and eval hanging issues (#6460) (d9e9814)
* code-scan: output valid JSON when no files to scan with --json flag (#6496) (8c41fce)
* config: handle setting maxConcurrency in config.yaml (#6526) (5443171)
* deps: downgrade zod-validation-error for ESM compatibility (#6471) (a39643a)
* deps: resolve Express CVE-2024-51999 vulnerability (#6457) (c2ef1ad)
* deps: update dependency @modelcontextprotocol/sdk to v1.24.0 [security] (#6463) (cfdffff)
* deps: update jws to fix security vulnerability (#6497) (28112f5)
* eval: correct share progress count to match actual results (#6513) (ea4410c)
* eval: handle missing defaultTest in extension-api hooks (#6504) (c0d111c)
* eval: include provider in Google Sheets output column headers (#6528) (ded540a)
* http: improve parsing of body in HTTP provider (#6484) (7665f48)
* logger: prevent Winston 'write after end' error during shutdown (#6511) (a5ad5cb)
* logger: prevent write-after-end error in shutdown (#6514) (c901d8d)
* providers: fix Golang and Ruby wrappers (#6506) (d429b00)
* providers: handle Vertex AI global region endpoint (#6570) (f8c0f76)
* providers: improve ChatKit multi-step workflow support (#6425) (ceef623)
* providers: improve ChatKit response capture reliability (#6482) (f251a03)
* python: fix provider path resolution (#6465) (20b363e)
* python: fix wrapper.py path resolution (#6500) (f617ee5)
* python: replace deprecated asyncio.iscoroutinefunction with inspect.iscoroutinefunction (#6551) (804d6c8)
* redteam: handle missing strategy test cases (#6485) (2ae2315)
* redteam: propagate abort signals through agentic strategy providers (#6412) (49b96e7)
* server: resolve drizzle migrations path for cloud bundled context (#6522) (6d2ff39)
Performance Improvements
* build: parallelize build steps and use esbuild minifier (#6494) (8b41b40)
Documentation
* site: display correct blog post dates regardless of user timezone (#6534) (3401ca1)
* site: fix responsive logo containers (#6470) (a94cef9)
* site: update Tabs Fakier GitHub profile URL (#6527) (d7959c6)
Miscellaneous Chores
* build: replace TypeScript enums with const objects (#6428) (ae2b609)
* ci: enforce npm version to prevent lockfile incompatibility (#6483) (ab0cccc)
* ci: remove packageManager to allow pnpm/yarn (#6512) (9b49e36)
* ci: update latest Docker tag on releases (#6477) (d213e33)
* deps: update dependency @apidevtools/json-schema-ref-parser to v15 (#6336) ([614aa66](https://github.com/promptfoo/promptfoo...
Read more
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.119.14
01 Dec 18:06
github-actions
0.119.14
3b24c55
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.119.14
0.119.14 (2025-12-01)
Features
* Add web search assertion type (#5111) (11c01cc)
* examples: add Strands Agents SDK example (#6384) (28c3d58)
* providers: add AWS Bedrock Converse API provider (#6348) (8ab3f96)
* providers: add Claude Agent SDK plugin support (#6377) (d3e67f5)
* providers: add comprehensive Azure model support (#6375) (2e53c08)
* providers: add Google Cloud Model Armor support to Vertex AI (#6365) (0d1641b)
* providers: add Groq reasoning models, Responses API, and built-in tools support (#6231) (7cbddd0)
* providers: add missing Claude Agent SDK options (#6389) (d0d227c)
* providers: add OpenAI ChatKit provider (#6406) (433ac65)
* providers: add OpenAI Codex SDK provider (#6321) (cc45c0f)
* providers: add verbosity and isReasoningModel config to azure:responses (#6382) (e99b8a8)
* providers: add xAI Responses API with Agent Tools support (#6386) (fad0fc8)
* redteam: update VLGuard to use original MIT-licensed dataset (#5809) (dbabbaf)
* Share trace data to promptfoo cloud (ce251ae)
* vs code red team extension (#6396) (406dc61)
Bug Fixes
* ci: restore original tag format for GitHub releases (#6402) (e49e5b8)
* cli: resolve eval command hanging by adding missing await calls (#6422) (137231a)
* deps: replace xlsx with read-excel-file to fix high severity vulnerability (#6357) (e6e2b98)
* deps: update node-forge to 1.3.2 to fix security vulnerability (#6395) (2b96ee2)
* evals: do not truncate image responses in eval (#6391) (d6fb07c)
* mcp: pass timeout configuration to MCP SDK calls (#6394) (d05da44)
* modelaudit: track scanner version and re-scan on version changes (#6361) (f0e8065)
* preserve all file:// references in vars context for runtime loading (#6393) (55c553c)
* prevent Node.js from hanging when importing promptfoo as a library (#6351) (af857a3)
* providers: fix ChatKit echo behavior and concurrency issues (#6420) (04df4a8)
* site: add truncation marker to blog post (#6392) (900fac2)
* webui: resolve Vitest timing issues causing test timeouts (#6356) (353ab11)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.119.13
25 Nov 16:39
github-actions
0.119.13
d141996
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.119.13
0.119.13 (2025-11-25)
Features
* ecommerce plugin pack (#6168) (152b1ff)
Bug Fixes
* deps: bump posthog-node from 5.13.2 to 5.14.0 for sha1-hulud mitigation (6a44eda)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.119.12
24 Nov 22:38
github-actions
0.119.12
efeccab
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.119.12
0.119.12 (2025-11-24)
Features
* changelog automation and validation (#6252) (ee74c4a)
* providers: add Anthropic structured outputs support (#6226) (1b1b9d2)
* providers: add Claude Opus 4.5 model support (#6339) (65f855d)
* providers: add Claude Opus 4.5 support for Anthropic, Google Vertex AI, and AWS Bedrock (#6340) (95780cb)
* providers: add metadata extraction for OpenAI Responses API (#6267) (f252f33)
* server: add server-side provider list customization (#6124) (fdb792a)
* util: add support for loading tool definitions from Python/JavaScript files (#6272) (41377d0)
Bug Fixes
* add data URL support for vision models with local images (#5725) (17442a8)
* assertions: use script output for file:// references in all assertion types (#6253) (246dcd8)
* cli: restore commandLineOptions support + fix cloud auto-sharing (#6190) (6df071f)
* code-scan: remove redundant PR comment when no issues found (#6317) (2a6e38c)
* codeScan: exit with code 0 when no files to scan (#6316) (78e5c52)
* logging: implement PROMPTFOO_LOG_DIR environment variable (#6179) (f3db2d9)
* providers: propagate agent errors in simulated-user provider (#6251) (2378f71)
* providers: support function providers in defaultTest.options.provider and assertions (#6174) (601f173)
* webui: prevent horizontal scrolling in metadata table (#6178) (5d36d8d)
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.119.11
24 Nov 05:17
MrFlounder
0.119.11
7797291
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.119.11
What's Changed
Bug Fixes
* fix(deps): update dependency @apidevtools/json-schema-ref-parser to v15 by @renovate[bot] in #6300
* fix(redteam): fix template bug in agentic strategies by @mldangelo in #6240
* fix: avoid sending target output to cloud if excludeTargetOutputFromAgenticAttackGeneration is set to true @MrFlounder in #6320
Chores
* revert: "fix(deps): update dependency @apidevtools/json-schema-ref-parser to v15" by @mldangelo in #6329
* refactor(webui): adopt React 19 patterns by @mldangelo in #6327
* chore: bump version 0.119.11 by @MrFlounder in #6331
Full Changelog: 0.119.10...0.119.11
Contributors
*
*
*
renovate, mldangelo, and MrFlounder
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
0.119.10
23 Nov 16:55
mldangelo
0.119.10
f140068
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
View all tags
0.119.10
What's Changed
Bug Fixes
* fix(providers): LiteLLM API key authentication with LITELLM_API_KEY env var by @mldangelo in #6322
* fix(webui): Basic strategy checkbox behavior in red team setup by @minhle1291 in #6313
* fix(code-scan): prevent GitHub API error when startLine equals line by @yash2998chhabria in #6314
* fix(app): Test generation tooltips remain visible after dialog is rendered by @will-holley in #6309
* fix(webui): allow thumbs up/down ratings to toggle off and remove manual grading by @JustinBeckwith in #6260
* fix(python): resolve Windows path compatibility issues in Python provider protocol by @mldangelo in #6262
Documentation
* docs(site): fix broken OpenAI config options link by @mldangelo in #6277
* docs(site): rewrite web viewer page by @mldangelo in #6264
Chores
* refactor(webui): migrate to React 19 patterns by @mldangelo in #6319
* chore(webui): replace emoji icons with Material-UI IconButton components by @JustinBeckwith in #6318
* chore: Revert "chore(deps): upgrade cache-manager from v4 to v7" by @JustinBeckwith in #6311
* chore: enforce explicit /index in directory imports by @mldangelo in #6263
* chore(deps): configure Renovate to track all package.json files by @JustinBeckwith in #6282
* chore: Update Strategy presets by @faizanminhas in #6275
* chore: bump version 0.119.10 by @mldangelo in #6324
Dependencies
* fix(deps): update dependency better-sqlite3 to v12.4.6 by @renovate in #6323
* chore(deps): update @biomejs/biome and all platform-specific CLI packages to 2.3.7 by @renovate in #6307
* chore(deps): update material-ui monorepo to v8 (major) by @renovate in #6298
* chore(deps): update vitest monorepo to v4 (major) by @renovate in #6299
* chore(deps): update dependency whatwg-url to v15 by @renovate in #6297
* chore(deps): update dependency recharts to v3 by @renovate in #6294
* chore(deps): update dependency react-markdown to v10 by @renovate in #6293
* chore(deps): update dependency react-is to v19 by @renovate in #6292
* chore(deps): update dependency react-error-boundary to v6 by @renovate in #6291
* chore(deps): update dependency gaxios to v7 by @renovate in #6288
* chore(deps): drop unused uuid types package by @JustinBeckwith in #6287
* chore(deps): update dependency framer-motion to v12 by @renovate in #6286
* chore(deps): update dependency @types/uuid to v11 by @renovate in #6285
* chore(deps): update dependency esbuild to v0.27.0 by @renovate in #6283
* chore(deps): upgrade http-z to v8 and @swc/core to v1.15.3 by @mldangelo in #6281
* chore(deps): update dependencies in 12 example projects by @mldangelo in #6280
* chore(deps): upgrade glob to v13 and mathjs to v15 by @mldangelo in #6279
* chore(deps): update minor and patch dependencies across all workspaces by @mldangelo in #6278
New Contributors
* @renovate made their first contribution in #6285
* @minhle1291 made their first contribution in #6313
Full Changelog: 0.119.9...0.119.10
Contributors
*
*
*
*
*
*
*
JustinBeckwith, renovate, and 5 other contributors
Assets 2
Loading
Uh oh!
There was an error while loading. Please reload this page.
All reactions
Previous 1 2 3 4 5 … 37 38 Next
Previous Next
Footer
© 2025 GitHub, Inc.
Footer navigation
* Terms
* Privacy
* Security
* Status
* Community
* Docs
* Contact
* Manage cookies
* Do not share my personal information
You can’t perform that action at this time.
|
For now, Differences are performed on text, not graphically, only the latest screenshot is available.
Screenshot requires Playwright/WebDriver enabled