Tetap teratur dengan koleksi
Simpan dan kategorikan konten berdasarkan preferensi Anda.
Untuk melengkapi disk booting, Anda dapat melampirkan
Solid State Drive lokal (SSD lokal)
ke node master, worker utama, dan worker sekunder di cluster Anda.
Saat SSD lokal disediakan untuk cluster, data HDFS dan data sementara, seperti output shuffle, menggunakan SSD lokal, bukan persistent disk boot.
SSD lokal dapat memberikan waktu baca dan tulis yang lebih cepat daripada persistent disk
(lihat Performa SSD Lokal).
Ukuran 375 GB untuk setiap SSD lokal sudah ditetapkan, tetapi Anda dapat memasang beberapa SSD lokal untuk meningkatkan penyimpanan SSD (lihat Tentang SSD Lokal).
Setiap SSD lokal dipasang ke /mnt/<id> di node cluster Dataproc.
SSD Lokal menggunakan ext4
sebagai sistem file default.
Menggunakan SSD lokal
Perintah gcloud
Gunakan perintah
gcloud dataproc clusters create
dengan flag --num-master-local-ssds,
--num-workers-local-ssds, dan
--num-secondary-worker-local-ssds untuk melampirkan SSD lokal ke node pekerja master, primer, dan sekunder cluster.
SSD Lokal dapat dilampirkan ke VM Dataproc menggunakan antarmuka SCSI
(Small Computer System Interface) atau NVME (Non-Volatile Memory Express) (lihat
performa SSD lokal).
Antarmuka SSD lokal VM cluster Dataproc default adalah antarmuka SCSI. Gunakan perintah
gcloud dataproc clusters create
dengan flag --master-local-ssd-interface,
--worker-local-ssd-interface, dan
--secondary-worker-local-ssd-interface
untuk menentukan antarmuka SSD lokal untuk node master, primer, dan sekunder.
Tetapkan kolom
numLocalSsds
di masterConfig, workerConfig, dan
secondaryWorkerConfigInstanceGroupConfig
dalam permintaan API
cluster.create
untuk melampirkan SSD lokal ke node master, pekerja utama, dan
pekerja sekunder cluster.
SSD Lokal dapat dilampirkan ke VM Dataproc menggunakan antarmuka SCSI
(Small Computer System Interface) atau NVME (Non-Volatile Memory Express) (lihat
performa SSD lokal).
Antarmuka SSD lokal VM cluster Dataproc default adalah antarmuka SCSI. Tetapkan kolom
localSsdInterface
di masterConfig, workerConfig, dan
secondaryWorkerConfigInstanceGroupConfig
dalam permintaan
API cluster.create
untuk menentukan antarmuka "SCSI" atau "NVME" guna melampirkan SSD lokal ke master cluster, node pekerja utama, dan node pekerja sekunder.
Konsol
Buat cluster dan pasang SSD lokal ke node pekerja master,
primer, dan sekunder dari panel Konfigurasi node di halaman
Buat cluster Dataproc
di konsol Google Cloud .
[[["Mudah dipahami","easyToUnderstand","thumb-up"],["Memecahkan masalah saya","solvedMyProblem","thumb-up"],["Lainnya","otherUp","thumb-up"]],[["Sulit dipahami","hardToUnderstand","thumb-down"],["Informasi atau kode contoh salah","incorrectInformationOrSampleCode","thumb-down"],["Informasi/contoh yang saya butuhkan tidak ada","missingTheInformationSamplesINeed","thumb-down"],["Masalah terjemahan","translationIssue","thumb-down"],["Lainnya","otherDown","thumb-down"]],["Terakhir diperbarui pada 2025-08-22 UTC."],[[["\u003cp\u003eLocal SSDs can be attached to master, primary worker, and secondary worker nodes in a cluster, offering faster read and write speeds compared to persistent disks.\u003c/p\u003e\n"],["\u003cp\u003eEach local SSD has a fixed size of 375GB, but multiple SSDs can be attached to increase the total SSD storage capacity.\u003c/p\u003e\n"],["\u003cp\u003eThe gcloud command-line tool and REST API provide methods to configure the number and interface type (SCSI or NVME) of local SSDs attached to each node type.\u003c/p\u003e\n"],["\u003cp\u003eLocal SSDs are automatically mounted to the \u003ccode\u003e/mnt/<id>\u003c/code\u003e directory on Dataproc cluster nodes and use the ext4 file system by default.\u003c/p\u003e\n"],["\u003cp\u003eYou can create a cluster with local SSDs from the "Configure Nodes" panel of the Dataproc cluster creation page of the google cloud console.\u003c/p\u003e\n"]]],[],null,["# Dataproc local SSDs\n\nTo supplement the boot disk, you can attach\n[local Solid State Drives (local SSDs)](/compute/docs/disks/local-ssd)\nto master, primary worker, and secondary worker nodes in your cluster.\nWhen local SSDs are provided to the cluster, both HDFS and scratch data,\nsuch as shuffle outputs, use the local SSDs instead of the boot\npersistent disk.\n\n- Local SSDs can provide faster read and write times than persistent disk (see [Local SSD Performance](/compute/docs/disks/local-ssd#performance)).\n- The 375GB size of each local SSD is fixed, but you can attach multiple local SSDs to increase SSD storage (see [About Local SSDs](/compute/docs/disks/local-ssd)).\n- Each local SSD is mounted to `/mnt/\u003cid\u003e` in Dataproc cluster nodes.\n- Local SSDs use [`ext4`](https://en.wikipedia.org/wiki/Ext4) as the default filesystem.\n\nUse local SSDs\n--------------\n\n### gcloud command\n\nUse the\n[`gcloud dataproc clusters create`](/sdk/gcloud/reference/dataproc/clusters/create)\ncommand with the `--num-master-local-ssds`,\n`--num-workers-local-ssds`, and\n`--num-secondary-worker-local-ssds` flags to attach local\nSSDs to the cluster's master, primary, and secondary worker\nnodes.\n\nLocal SSDs can be attached to Dataproc VMs using a SCSI\n(Small Computer System Interface) or NVME (Non-Volatile Memory Express) interface (see\n[local SSD performance](/compute/docs/disks/local-ssd#performance)).\nThe default Dataproc cluster VM local SSD interface is the SCSI interface. Use the\n[gcloud dataproc clusters create](/sdk/gcloud/reference/dataproc/clusters/create)\ncommand with the `--master-local-ssd-interface`,\n`--worker-local-ssd-interface`, and\n`--secondary-worker-local-ssd-interface` flags\nto specify the local SSD interface for master, primary, and secondary\nworker nodes.\n\n**Example:** \n\n```\ngcloud dataproc clusters create cluster-name \\\n --region=region \\\n --num-master-local-ssds=1 \\\n --num-worker-local-ssds=1 \\\n --num-secondary-worker-local-ssds=1 \\\n --master-local-ssd-interface=NVME \\\n --worker-local-ssd-interface=NVME \\\n --secondary-worker-local-ssd-interface=NVME \\\n ... other args ...\n```\n\n### REST API\n\nSet the\n[numLocalSsds](/dataproc/docs/reference/rest/v1/ClusterConfig#diskconfig)\nfield in the `masterConfig`, `workerConfig`, and\n`secondaryWorkerConfig`\n[InstanceGroupConfig](/dataproc/docs/reference/rest/v1/ClusterConfig#InstanceGroupConfig)\nin a\n[cluster.create](/dataproc/docs/reference/rest/v1/projects.regions.clusters/create)\nAPI request to attach local SSDs to the cluster's master, primary worker, and\nsecondary worker nodes.\n\nLocal SSDs can be attached to Dataproc VMs using a SCSI\n(Small Computer System Interface) or NVME (Non-Volatile Memory Express) interface (see\n[local SSD performance](/compute/docs/disks/local-ssd#performance)).\nThe default Dataproc cluster VM local SSD interface is the SCSI interface. Set the\n[localSsdInterface](/dataproc/docs/reference/rest/v1/ClusterConfig#diskconfig)\nfield in the `masterConfig`, `workerConfig`, and\n`secondaryWorkerConfig`\n[InstanceGroupConfig](/dataproc/docs/reference/rest/v1/ClusterConfig#InstanceGroupConfig)\nin a\n[cluster.create](/dataproc/docs/reference/rest/v1/projects.regions.clusters/create)\nAPI request to specify the \"SCSI\" or \"NVME\" interface to attach local SSDs to the cluster's master,\nprimary worker, and secondary worker nodes.\n\n### Console\n\nCreate a cluster and attach local SSDs to the master,\nprimary, and secondary worker nodes from the Configure nodes panel of the\nDataproc\n[Create a cluster](https://console.cloud.google.com/dataproc/clustersAdd) page\nof the Google Cloud console."]]
