赵月辉 / fastgpt-migrated

* update admin modal dependencies

* fix: workflow tool ui

* fix: response data

* fix(chat): limit quick apps max amount to 3

* chore: remove frontend restrict

* fix(chat): validate legacy quick app settings

* Account verification (#7390)

* feat: add account verification service

* feat: login access account verification service

* fix(account-verification): remove googleAuthToken, username with prefix

* Account verification (#7418)

* Account verification (#7390)

* feat: add account verification service

* feat: login access account verification service

* fix(account-verification): remove googleAuthToken, username with prefix

* feat(account-verify): add tmp_datas verification, remove auth_code

* fix account-verification

* fix account-verification

* fix account-verification

* fix account-verification

* fix account-verification

* Refine account verification behavior

* fix(auth): support independent verification codes

* refactor: migrate frequency limits to redis

* refactor: centralize rate limit policies

* update version

* update doc

* doc

* perf: snadbox

* test: sync agent reminder assertions

* fix: reject unknown password reset accounts

* fix(account-verify): ui (#7458)

* fix(account-verify): ui

* fix(account-verify): fix off email register

* submodule

* fix(account-verify): refine send code validation

---------

Co-authored-by: light5980 <148292178+shortlight5980@users.noreply.github.com>

* fix(sandbox): handle OpenSandbox PVC lifecycle races and UID preconditions (#7423)

* fix(sandbox): handle OpenSandbox PVC lifecycle races and UID preconditions

* refactor(sandbox): operate volume manager on explicit claimName

* refactor(sandbox): configure OpenSandbox image and compact volume names

refactor(sandbox): unify volume schemas and volume-manager contracts

fix(sandbox): harden OpenSandbox volume lifecycle

* fix(sandbox): handle stale restore rollback phases and legacy volume fallback

* refactor(redis): establish runtime and keyspace

* refactor(redis): add capabilities and script registry

* refactor(redis): centralize phase 3a stores

* refactor(redis): migrate wechat qr login store

* refactor(redis): move Redis access into DAL

* refactor(redis): migrate lease repository

* refactor(redis): migrate stop signal and stream resume repositories

* refactor(redis): complete DAL migration

* test(redis): complete DAL Redis test coverage

* chore(redis): align pro lockfile importer

* test(redis): update service and app redis mocks

* chore(redis): align pro migration submodule

* refactor(redis): consolidate cache migration

* refactor(redis): convert runtime to class

* chore(deps): update redis and tooling dependencies

* refactor(redis): move BullMQ services into DAL

* fix(redis): harden DAL checks and lifecycle

* chore: fix bullmq to 5.52.2

* chore: bump deps

* test(redis): mock captured BullMQ binding

* lock

* docs: consolidate DAL and WeChat designs

* chore: remove DAL review artifacts

---------

Co-authored-by: Archer <545436317@qq.com>

* docs: update v4.16 release notes

* fix(dataset): support legacy CSV imports

* chore(i18n): refine dataset import prompts

* chore(i18n): show current dataset CSV format

* feat(dataset): support Excel template imports

* fix(dataset): reuse readFile worker for imports

* docs(dataset): document template imports

* fix(security): harden system and temporary tool secrets

Synchronize toolset secrets from parent records, clear temporary values when switching secret sources, and keep production system secrets out of debug tool flows.

Add regression coverage for parent-child authority, debug fail-closed behavior, and app secret normalization.

* fix(security): encrypt system tool secrets

Store plugin system secrets as AES-GCM wrappers, mask configured values in administrator responses, and keep legacy plaintext and inputListVal records readable during migration. Update the administrator form to edit write-only markers without sending stored ciphertext back to the server.

* fix(ui): use plain input for system secrets

Keep system secret values visible while editing and continue to replace saved values with the write-only configured marker after reload.

* refactor(workflow): simplify workflow configuration logic

* refactor: match ask ui with latest design

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: disable transitions for ask ui

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: tweaks to ask_user prompt

Signed-off-by: Nixieboluo <me@sagirii.me>

---------

Signed-off-by: Nixieboluo <me@sagirii.me>

Fix formatting and punctuation in README.md

* feat(agent): support helper tool loops and injected prompts

* prompt

* remove log

* feat: prepare support for ask_user v2 in aux gen

Signed-off-by: Nixieboluo <me@sagirii.me>

* fix: align ask composer UI

* feat: prepare support for ask_user v2 in agent

Signed-off-by: Nixieboluo <me@sagirii.me>

* feat: unified frontend logic for ask_user v2

Signed-off-by: Nixieboluo <me@sagirii.me>

* test: update tests for ask_user v2

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: more strict ask_user schema validation

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: add transitions and hide answer when retrying

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: reorganize ask v2 composer ui

Signed-off-by: Nixieboluo <me@sagirii.me>

* test: update tests

Signed-off-by: Nixieboluo <me@sagirii.me>

* feat: format ask user answers

* refactor: remove compat for legacy agent_ask in aux gen

Signed-off-by: Nixieboluo <me@sagirii.me>

* fix: agent ask composer ui focus handling

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: cleanup compatibility fallback for agent ask

Signed-off-by: Nixieboluo <me@sagirii.me>

* feat: legacy ask_user record compatibility

Signed-off-by: Nixieboluo <me@sagirii.me>

* test: fix test mismatches

Signed-off-by: Nixieboluo <me@sagirii.me>

* feat: convert legacy ask to the new one

Signed-off-by: Nixieboluo <me@sagirii.me>

* chore: trigger correct pro build

Signed-off-by: Nixieboluo <me@sagirii.me>

* refactor: remove legacy auxiliary ask fallback

* chore: update pro storage mock fix

Signed-off-by: Archer <545436317@qq.com>

* submodule

---------

Signed-off-by: Nixieboluo <me@sagirii.me>
Signed-off-by: Archer <545436317@qq.com>
Co-authored-by: Archer <545436317@qq.com>

* fix(workflow): preserve explicit tool input render types

* fix(tool-runtime): exclude referenced inputs from model schema

* perf: timeout and doc

* fix(docs): use valid dotenv code fence

* feat: optimize object storage multipart upload

* feat: unify browser object storage uploads

* chore: update storage package and pro submodule

* Bump deps

* fix: configure home chat custom PDF parsing

* fix: extend dataset parsing timeout

* fix: ocr comments

* fix: resolve pro submodule conflict

* chore: remove invalid multipart benchmark command

* refactor: select multipart uploads by file size

---------

Co-authored-by: Archer <545436317@qq.com>

The schema-detection aggregate in exportAll builds its $match from teamId
(returned by authDataset as a string). find() casts the string to ObjectId,
but aggregate() does not schema-cast $match values, so the aggregation
matched zero documents. exportSchema became undefined, indexCount/hasMetadata
fell back to 0/false, and the CSV header collapsed to q,a.

Wrap teamId and dataset _ids in Types.ObjectId so the aggregate $match works.
dataset _ids are already ObjectId from .lean(), so that wrap is defensive.

Co-authored-by: Claude <noreply@anthropic.com>

* Fix regex for S3 markdown and improve VLM model fallback

Update regex pattern for S3 markdown key and adjust fallback logic for VLM model retrieval.

[^)]+? → [^)>]+?：在排除列表中增加 > 字符
(${pattern}) → <?(${pattern})>?：URL 前后添加可选的 <> 包裹匹配

* Implement space replacement in S3 key handling

Add function to replace spaces with underscores in S3 key.

在 replaceParentheses 后新增 replaceSpaces，将所有空白字符（\s+）替换为下划线，避免新上传的文件产生含空格的 S3 key。

* Fix filename formatting tests in utils.test.ts

Updated test cases to ensure formatted filenames replace spaces with underscores and handle multiple spaces correctly.

更新 getFormatedFilename 的空格文件名测试期望
更新真实场景的测试期望
新增 5 个空格替换测试用例（单独替换、括号+空格组合、连续空格、首尾空格等场景）

* fix: handle S3 markdown key edge cases

---------

Co-authored-by: Xianquan <whoeverimf5@gmail.com>

* feat: add metadata field to dataset_data for custom metadata support\n\n- Zod schemas: add metadata to DatasetDataSchema, DatasetDataItemSchema, CreateDatasetDataPropsSchema, UpdateDatasetDataPropsSchema, PushDataChunkSchema, GetDataListItemSchema\n- MongoDB schemas: add metadata to dataset_datas and dataMetadata to dataset_trainings\n- CSV import: parse header row to identify non-q/a/indexes columns as metadata keys\n- Training pipeline: pass metadata through training queue (dataMetadata) to dataset_data (metadata)\n- Search output: include metadata in search result items via buildSearchResultItem\n- API: include metadata in v2/list responses\n- Template: update download template header to demo metadata column, relax header validation to check only first two columns are q,a\n\nCo-Authored-By: Claude <noreply@anthropic.com>

* fix: preserve dataset metadata across import and export

* chore: remove metadata design document

* fix: allow a single metadata template column

* fix: reject legacy dataset template headers

* docs: add dataset metadata release note

---------

Co-authored-by: hexiaoyan30010 <30010@sangfor.com>
Co-authored-by: Archer <545436317@qq.com>

* Add V4.15.6 documentation translations

* api

* fix(chat): restore share context and mobile citation details

* fix(chat): restore share context and mobile citation details

* submodule

* fix(chat): handle hydration failures and mobile quote actions

* chore(chat): keep quote review scope focused

---------

Co-authored-by: Archer <545436317@qq.com>

* refactor(tool): unify tool input runtime compilation

* fix(tool): hide schema annotations from models

* test(tool): expect filtered schema annotations

* fix(tool): resolve app typecheck errors

* fix(tool): drop sandbox type workaround

* fix(workflow): allow external values to override internal defaults

* fix(workflow): preserve plugin input types across workflow serialization

* fix(jsonschema): preserve enum constraints for agent-generated inputs

* test(workflow): allow parent input to override internal defaults

* feat(skill): optimize skill first-use UX and cross-tab associate flow

Add dashboard empty-state guidance, skill selector create redirect,
and cross-tab associate bridge for Agent skill binding after creation.

Co-authored-by: Cursor <cursoragent@cursor.com>

* refactor(skill): normalize root parentId to null and simplify modal/list flow

- Root directory is now uniformly `null`; collapse fetchParentId/parentId in
  useSkillSelectData and drop `?? ''` in skill context (server treats falsy
  parentId as root, so behavior is unchanged).
- Create/Import modals no longer swallow onSuccess errors with a toast;
  callers handle exceptions and list refresh becomes best-effort.
- Drop redundant redirectToDetail in CreateSkillModal; openDetailInNewTab
  fully controls new-tab vs current-page navigation.
- Extract passesSandboxGuard helper in skill List.
- Dedupe the shared glow-ellipse/filter geometry in SkillEmptyActionCard.

refactor(skill): remove unused skill association logic and clean up related components

chore(skill): update submodule and remove unused SVG assets

- Updated submodule reference in `pro`.
- Deleted unused SVG files related to skill selection and import functionality, including `createCardBgDefault.svg`, `createCardBgHover.svg`, `importCardBgDefault.svg`, `importCardBgHover.svg`, and `skillSelectEmptyIcon.svg`.
- Refactored `SkillSelectModal` and related components to streamline button actions and improve code clarity.

refactor(skill): simplify EmptyTip component and update SkillSelectModal logic

* feat(skill): implement skill import size validation and enhance user feedback

* refactor(skill): simplify empty card glow effect and import size check

---------

Co-authored-by: siigure <siiigureouo@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

* fix http tool array json schema

* optimize http tool schema migration queries

* submodule

* document http tool schema migration

* fix: external

* refactor(skill): stream skill package import directly to S3

* refactor(sandbox): stream sandbox file upload directly via octet-stream

* refactor(sandbox): derive limits from storage size

* refactor(sandbox): rename storage size env

* refactor(sandbox): use Gi storage env name

* chore: keep v4.15 deployment templates unchanged