[Bug]一个BE节点突然报 could not find tablet 10207，表无法查看，无法插入数据

[helxm]

Search before asking

• I had searched in the issues and found no similar issues.

Version

2.1.7

What's Wrong?

I20250115 14:18:56.510421 26519 storage_engine.cpp:733] finish to clear transaction task. transaction_id=1479786
I20250115 14:18:56.510488 26519 task_worker_pool.cpp:1652] finish to clear transaction task. signature=1479786, transaction_id=1479786
I20250115 14:18:56.510700 26519 task_worker_pool.cpp:1636] get clear transaction task. signature=1479785, transaction_id=1479785, partition_id_size=0
I20250115 14:18:56.510715 26519 storage_engine.cpp:705] begin to clear transaction task. transaction_id=1479785
I20250115 14:18:56.510721 26519 storage_engine.cpp:733] finish to clear transaction task. transaction_id=1479785
I20250115 14:18:56.510756 26519 task_worker_pool.cpp:1652] finish to clear transaction task. signature=1479785, transaction_id=1479785
I20250115 14:18:56.535512 26252 wal_dirs_info.cpp:98] failed to update wal dir used info, err: {}
I20250115 14:18:56.599411 130527 task_worker_pool.cpp:337] successfully submit task|type=DROP|signature=10207
W20250115 14:18:56.599495 26508 tablet_manager.cpp:653] tablet cannot be used. tablet=10207
W20250115 14:18:56.601967 26508 status.h:413] meet error status: [NOT_FOUND]could not find tablet 10207

    0#  doris::drop_tablet_callback(doris::StorageEngine&, doris::TAgentTaskRequest const&) at /home/zcp/repo_center/doris_release/doris/be/src/agent/task_worker_pool.cpp:0
    1#  std::_Function_handler<void (), doris::TaskWorkerPool::submit_task(doris::TAgentTaskRequest const&)::$_0::operator()<doris::TAgentTaskRequest const&>(doris::TAgentTaskRequest const&) const::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/agent/task_worker_pool.cpp:445
    2#  doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
    3#  doris::Thread::supervise_thread(void*) at /var/local/ldb-toolchain/bin/../usr/include/pthread.h:562
    4#  start_thread
    5#  __clone

W20250115 14:18:56.601994 26508 task_worker_pool.cpp:1443] failed to drop tablet|signature=10207|tablet_id=10207|error=[NOT_FOUND]could not find tablet 10207

    0#  doris::drop_tablet_callback(doris::StorageEngine&, doris::TAgentTaskRequest const&) at /home/zcp/repo_center/doris_release/doris/be/src/agent/task_worker_pool.cpp:0
    1#  std::_Function_handler<void (), doris::TaskWorkerPool::submit_task(doris::TAgentTaskRequest const&)::$_0::operator()<doris::TAgentTaskRequest const&>(doris::TAgentTaskRequest const&) const::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/agent/task_worker_pool.cpp:445
    2#  doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
    3#  doris::Thread::supervise_thread(void*) at /var/local/ldb-toolchain/bin/../usr/include/pthread.h:562
    4#  start_thread
    5#  __clone

I20250115 14:29:29.927836 2383 doris_main.cpp:382] version doris-2.1.7-rc03(AVX2) RELEASE (build git://vm-36@443e87e)
Built on Wed, 06 Nov 2024 15:34:46 CST by vm-36
W20250115 14:29:29.928817 2383 options.cpp:177] failed to parse store path /home/doris/data, res=[IO_ERROR]failed to canonicalize /home/doris/data
E20250115 14:29:29.929095 2383 doris_main.cpp:408] parse config storage path failed, path=/home/doris/data
I20250115 14:56:17.851375 62887 doris_main.cpp:382] version doris-2.1.7-rc03(AVX2) RELEASE (build git://vm-36@443e87e)
Built on Wed, 06 Nov 2024 15:34:46 CST by vm-36
E20250115 14:56:17.870409 62887 doris_main.cpp:432] a broken disk is found /home/doris/data
I20250115 15:02:15.625867 11730 doris_main.cpp:382] version doris-2.1.7-rc03(AVX2) RELEASE (build git://vm-36@443e87e)
Built on Wed, 06 Nov 2024 15:34:46 CST by vm-36
E20250115 15:02:15.677755 11730 doris_main.cpp:432] a broken disk is found /home/doris/data
I20250115 15:54:21.932317 97024 doris_main.cpp:382] version doris-2.1.7-rc03(AVX2) RELEASE (build git://vm-36@443e87e)
Built on Wed, 06 Nov 2024 15:34:46 CST by vm-36
E20250115 15:54:21.944967 97024 doris_main.cpp:432] a broken disk is found /home/doris/data

What You Expected?

如何恢复数据及程序

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct