Storage Error: part: 91, error: E_RPC_FAILURE(-3)

Nebula details

  • Nebula Graph version 2
  • Deployment type-- 3 node cluster
  • Hardware info
    • Disk in use SSD
    • 32 CPU and 64 GB RAM
  • How you have created the graph space in question. Execute describe space xxx to get the information
    partition number 100, repl factor 3, default group, fixed string vid 36 byte
  • Detailed description of the problem

When I try to execute INSERT EDGE or INSERT VERTEX queries using nebula graph studio, I get this error and I’m not sure why:
Storage Error: part: 91, error: E_RPC_FAILURE(-3).

I checked the english nebula database manual and it said to add this line the config file:
–storage_client_timeout_ms=60000
but the error persisted. How can I fix this problem?

1 Like

Dear @avarma20 ,
What is the SHOW HOSTS showing? Is the storaged up and running?
Could you check/provide server-side logs?

I get this error

 ErrMsg: Storage Error: part: 45, error: E_PART_NOT_FOUND(-16)., ErrCode: -1005

log in graphd

E0831 11:41:25.646860    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 33
E0831 11:41:25.646883    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 21
E0831 11:41:25.646893    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 81
E0831 11:41:25.646901    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 45
E0831 11:41:25.646910    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 87
E0831 11:41:25.646926    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 15
E0831 11:41:25.646939    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 93
E0831 11:41:25.646951    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 27
E0831 11:41:25.646962    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 63
E0831 11:41:25.646972    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 57
E0831 11:41:25.646981    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 9
E0831 11:41:25.646992    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 75
E0831 11:41:25.647001    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 39
E0831 11:41:25.647011    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 3
E0831 11:41:25.647022    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 69
E0831 11:41:25.647032    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 99
E0831 11:41:25.647040    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 51
E0831 11:41:25.647056    42 StorageAccessExecutor.h:122] Storage Error: part: 33, error: E_PART_NOT_FOUND(-16).
E0831 11:41:25.647092    44 QueryInstance.cpp:110] Storage Error: part: 33, error: E_PART_NOT_FOUND(-16).
E0831 11:41:26.696188    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 33
E0831 11:41:26.696213    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 21
E0831 11:41:26.696223    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 81
E0831 11:41:26.696233    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 45
E0831 11:41:26.696247    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 87
E0831 11:41:26.696255    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 15
E0831 11:41:26.696264    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 93
E0831 11:41:26.696271    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 27
E0831 11:41:26.696280    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 63
E0831 11:41:26.696287    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 57
E0831 11:41:26.696295    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 9
E0831 11:41:26.696302    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 75
E0831 11:41:26.696310    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 39
E0831 11:41:26.696318    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 3
E0831 11:41:26.696326    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 69
E0831 11:41:26.696333    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 99
E0831 11:41:26.696341    40 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 51
E0831 11:41:26.696352    40 StorageAccessExecutor.h:122] Storage Error: part: 33, error: E_PART_NOT_FOUND(-16).
E0831 11:41:26.696377    42 QueryInstance.cpp:110] Storage Error: part: 33, error: E_PART_NOT_FOUND(-16).
E0831 11:41:27.755615    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 33
E0831 11:41:27.755641    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 21
E0831 11:41:27.755657    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 81
E0831 11:41:27.755669    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 45
E0831 11:41:27.755681    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 87
E0831 11:41:27.755689    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 15
E0831 11:41:27.755697    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 93
E0831 11:41:27.755704    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 27
E0831 11:41:27.755712    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 63
E0831 11:41:27.755720    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 57
E0831 11:41:27.755728    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 9
E0831 11:41:27.755735    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 75
E0831 11:41:27.755743    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 39
E0831 11:41:27.755750    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 3
E0831 11:41:27.755757    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 69
E0831 11:41:27.755765    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 99
E0831 11:41:27.755782    44 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 51
E0831 11:41:27.755795    44 StorageAccessExecutor.h:122] Storage Error: part: 33, error: E_PART_NOT_FOUND(-16).
E0831 11:41:27.755818    44 QueryInstance.cpp:110] Storage Error: part: 33, error: E_PART_NOT_FOUND(-16).
E0831 11:41:28.835016    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 63
E0831 11:41:28.835036    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 69
E0831 11:41:28.835044    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 57
E0831 11:41:28.835053    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 51
E0831 11:41:28.835060    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 9
E0831 11:41:28.835069    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 15
E0831 11:41:28.835076    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 3
E0831 11:41:28.835091    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 87
E0831 11:41:28.835103    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 21
E0831 11:41:28.835111    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 81
E0831 11:41:28.835121    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 45
E0831 11:41:28.835131    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 33
E0831 11:41:28.835141    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 99
E0831 11:41:28.835151    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 39
E0831 11:41:28.835162    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 93
E0831 11:41:28.835172    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 27
E0831 11:41:28.835181    42 StorageAccessExecutor.h:42] InsertVerticesExecutor failed, error E_PART_NOT_FOUND, part 75
E0831 11:41:28.835193    42 StorageAccessExecutor.h:122] Storage Error: part: 63, error: E_PART_NOT_FOUND(-16).
E0831 11:41:28.835225    42 QueryInstance.cpp:110] Storage Error: part: 63, error: E_PART_NOT_FOUND(-16).
E0831 11:41:43.401557    16 GeneratedCodeHelper.cpp:183] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:41:43.401595    16 GeneratedCodeHelper.cpp:115] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:41:43.401603    16 GeneratedCodeHelper.cpp:77] invalid message from client in function process
E0831 11:42:04.899190    20 GeneratedCodeHelper.cpp:183] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:42:04.899222    20 GeneratedCodeHelper.cpp:115] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:42:04.899232    20 GeneratedCodeHelper.cpp:77] invalid message from client in function process
E0831 11:42:11.760253    23 GeneratedCodeHelper.cpp:183] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:42:11.760283    23 GeneratedCodeHelper.cpp:115] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:42:11.760293    23 GeneratedCodeHelper.cpp:77] invalid message from client in function process
E0831 11:42:19.967459    15 GeneratedCodeHelper.cpp:183] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:42:19.967490    15 GeneratedCodeHelper.cpp:115] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:42:19.967499    15 GeneratedCodeHelper.cpp:77] invalid message from client in function process
E0831 11:44:49.797235    13 GeneratedCodeHelper.cpp:183] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:44:49.797837    13 GeneratedCodeHelper.cpp:115] received invalid message from client: No version identifier... old protocol client in strict mode? sz=1195725856
E0831 11:44:49.797858    13 GeneratedCodeHelper.cpp:77] invalid message from client in function process