Rpcdetailed - aajisaka/hadoop-metrics GitHub Wiki

"(RPC method name)NumOps" metrics show total number of (RPC method name) calls, and "(RPC method name)AvgTime" show average time of (RPC method name) calls in milliseconds. Here is the list of RPC method name. For more details, see org.apache.hadoop.ipc.metrics.RpcDetailMetrics.java.

NameNode

port=8020 (or the port set by fs.default.name)

  • VersionRequest
  • RegisterDatanode
  • SendHeartbeat
  • BlockReport
  • GetFsStats
  • SetSafeMode
  • GetDatanodeReport
  • GetFileInfo
  • GetFileLinkInfo
  • GetServerDefaults
  • Delete
  • Mkdir
  • GetListing
  • GetBlockLocations
  • Rename2
  • Create
  • AddBlock
  • BlockReceivedAndDeleted
  • Complete
  • SetPermission
  • SetReplication
  • Fsync
  • RenewLease
  • Rename

For more details, see org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.java

ResourceManager

port=8033 (or the port set by yarn.resourcemanager.admin.address)

  • RefreshQueues
  • RefreshNodes
  • RefreshSuperUserGroupsConfiguration
  • RefreshUserToGroupsMappings
  • RefreshAdminAcls
  • RefreshServiceAcls
  • GetGroupsForUser

For more details, see org.apache.hadoop.yarn.server.resourcemanager.AdminService.java

port=8032 (or the port set by yarn.resourcemanager.address)

  • GetNewApplication
  • SubmitApplication
  • GetApplicationReport
  • ForceKillApplication
  • GetClusterMetrics
  • GetApplications
  • GetClusterNodes
  • GetQueueInfo
  • GetQueueUserAcls
  • GetDelegationToken
  • RenewDelegationToken
  • DeleteDelegationToken

For more details, see org.apache.hadoop.yarn.server.resourcemanagerClientRMService.java.

port=8031 (or the port set by yarn.resourcemanager.resource-tracker.address)

  • RegisterNodeManager
  • NodeHeartbeat

For more details, see org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.java.

port=8030 (or the port set by yarn.resourcemanager.scheduler.address)

  • RegisterApplicationMaster
  • Allocate
  • FinishApplicationMaster

For more details, see org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.java.

NodeManager

port=8040 (or the port set by yarn.nodemanager.localizer.address)

  • Heartbeat

For more details, see org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.java.

a high port (or the port set by yarn.nodemanager.address)

  • StartContainers
  • StopContainers
  • GetContainerStatuses

For more details, see org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.java.

MRAppMaster

a high port

  • GetConnectAddress
  • GetJobReport
  • GetTaskReport
  • GetTaskAttemptReport
  • GetCounters
  • GetTaskAttemptCompletionEvents
  • GetTaskReports
  • GetDiagnostics
  • KillJob
  • KillTask
  • KillTaskAttempt
  • FailTaskAttempt
  • GetDelegationToken

For more details, see org.apache.hadoop.mapreduce.v2.app.client.MRClientService.java.

a high port

  • VersionID
  • GetTask
  • FatalError
  • Done
  • CanCommit
  • CommitPending
  • FsError
  • ShuffleError
  • GetMapCompletionEvents
  • Ping
  • ReportDiagnosticInfo
  • StatusUpdate
  • ReportNextRecordRange

For more details, see org.apache.hadoop.mapred.TaskAttemptListImpl.java.