Tetap teratur dengan koleksi
Simpan dan kategorikan konten berdasarkan preferensi Anda.
Menggunakan transfer pihak ketiga
Transfer pihak ketiga untuk BigQuery Data Transfer Service memungkinkan Anda menjadwalkan dan mengelola tugas pemuatan berulang secara otomatis
untuk sumber data eksternal seperti
Salesforce CRM, Adobe Analytics, dan Facebook Ads.
Pastikan orang yang melakukan transfer memiliki izin yang diperlukan
berikut di BigQuery:
Izin bigquery.transfers.update untuk membuat transfer
Izin bigquery.datasets.get dan bigquery.datasets.update pada set data target
Peran IAM bigquery.admin yang telah ditetapkan mencakup izin bigquery.transfers.update, bigquery.datasets.update, dan bigquery.datasets.get. Untuk mengetahui informasi lebih lanjut tentang
peran IAM dalam BigQuery Data Transfer Service, lihat
Kontrol akses.
Lihat dokumentasi untuk sumber data pihak ketiga guna memastikan Anda telah
mengonfigurasi izin apa pun yang diperlukan untuk mengaktifkan transfer.
Jika ingin menyiapkan notifikasi operasi transfer untuk Pub/Sub,
Anda harus memiliki izin pubsub.topics.setIamPolicy. Izin Pub/Sub tidak diperlukan jika Anda baru saja menyiapkan notifikasi email. Untuk
mengetahui informasi selengkapnya, lihat
Notifikasi operasi BigQuery Data Transfer Service.
Batasan
Transfer pihak ketiga tunduk pada batasan berikut:
Anda harus membuat atau memperbarui transfer pihak ketiga menggunakan
konsolGoogle Cloud .
Saat ini, Anda tidak dapat mengonfigurasi atau memperbarui transfer pihak ketiga menggunakan
alat command line bq.
Menyiapkan transfer data pihak ketiga
Untuk membuat transfer data pihak ketiga menggunakan konsol Google Cloud :
Di halaman dokumentasi untuk penyedia pihak ketiga, klik
Daftar. Proses pendaftaran mungkin memerlukan waktu beberapa saat.
Setelah pendaftaran selesai, klik Konfigurasi Transfer.
Di halaman Melakukan Transfer:
Untuk Sumber, pilih sumber data pihak ketiga yang sesuai. Anda dapat
mengklik Jelajahi Sumber Data untuk melihat daftar penyedia pihak ketiga
di Google Cloud Marketplace.
Untuk Nama tampilan, masukkan nama transfer, seperti My Transfer.
Nama transfer dapat berupa nilai apa pun yang memudahkan Anda mengidentifikasi
transfer jika perlu mengubahnya nanti.
Untuk Jadwal, biarkan nilai default (Mulai sekarang) atau klik Mulai pada waktu yang ditentukan.
Untuk Ulangi, pilih opsi frekuensi transfer dijalankan.
Opsi meliputi:
Harian (default)
Mingguan
Bulanan
Khusus
Sesuai permintaan
Jika Anda memilih opsi selain Harian, opsi tambahan
tersedia. Misalnya, jika memilih Mingguan, akan ada opsi yang muncul
untuk memilih hari.
Untuk Tanggal mulai dan waktu pelaksanaan, masukkan tanggal dan waktu untuk memulai
transfer. Jika Anda memilih Mulai sekarang, opsi ini akan dinonaktifkan.
Untuk Set data tujuan, pilih set data yang Anda buat untuk menyimpan
data.
(Opsional) Di bagian Opsi notifikasi:
Klik tombol untuk mengaktifkan notifikasi email. Saat Anda mengaktifkan opsi
ini, administrator transfer akan menerima notifikasi email saat
transfer yang dijalankan gagal.
Untuk Pilih topik Pub/Sub, pilih nama topic
atau klik Buat topik untuk membuatnya. Opsi ini mengonfigurasi
notifikasi
operasi Pub/Sub untuk transfer Anda.
Klik Hubungkan Sumber.
Saat diminta, klik Setuju untuk memberi izin ke BigQuery Data Transfer Service
agar terhubung ke sumber data dan mengelola data Anda di
BigQuery.
Ikuti petunjuk di halaman berikutnya untuk mengonfigurasi koneksi
ke sumber data eksternal Anda.
Setelah Anda menyelesaikan langkah-langkah konfigurasi, klik Simpan.
Memecahkan masalah penyiapan transfer pihak ketiga
Jika Anda mengalami masalah saat menyiapkan transfer, hubungi vendor pihak ketiga
yang sesuai. Informasi kontak tersedia di halaman dokumentasi transfer
di Google Cloud Marketplace.
Membuat kueri data Anda
Saat data Anda ditransfer ke BigQuery, data tersebut akan ditulis ke tabel berpartisi berdasarkan waktu penyerapan. Untuk informasi selengkapnya, lihat Pengantar tabel berpartisi.
Jika membuat kueri tabel secara langsung, bukan menggunakan tabel virtual yang dihasilkan secara otomatis, Anda harus menggunakan kolom semu _PARTITIONTIME dalam kueri. Untuk mengetahui informasi selengkapnya, lihat Membuat kueri tabel berpartisi.
Untuk informasi cara menggunakan transfer, termasuk mendapatkan informasi tentang konfigurasi transfer, membuat listingan konfigurasi transfer, dan melihat histori pelaksanaan transfer, lihat Menangani transfer.
[[["Mudah dipahami","easyToUnderstand","thumb-up"],["Memecahkan masalah saya","solvedMyProblem","thumb-up"],["Lainnya","otherUp","thumb-up"]],[["Sulit dipahami","hardToUnderstand","thumb-down"],["Informasi atau kode contoh salah","incorrectInformationOrSampleCode","thumb-down"],["Informasi/contoh yang saya butuhkan tidak ada","missingTheInformationSamplesINeed","thumb-down"],["Masalah terjemahan","translationIssue","thumb-down"],["Lainnya","otherDown","thumb-down"]],["Terakhir diperbarui pada 2025-08-17 UTC."],[[["\u003cp\u003eThird party transfers in BigQuery Data Transfer Service enable automated, recurring data loading from external sources like Salesforce CRM, Adobe Analytics, and Facebook Ads.\u003c/p\u003e\n"],["\u003cp\u003eBefore creating a third party transfer, you must have enabled BigQuery Data Transfer Service, created a BigQuery dataset, and ensured proper permissions like \u003ccode\u003ebigquery.transfers.update\u003c/code\u003e and \u003ccode\u003ebigquery.datasets.update\u003c/code\u003e on the dataset.\u003c/p\u003e\n"],["\u003cp\u003eThird party transfers must be created or updated through the Google Cloud console, as they are not currently supported by the bq command-line tool.\u003c/p\u003e\n"],["\u003cp\u003eSetting up a third party transfer involves navigating to the Google Cloud Marketplace, selecting a provider, enrolling, configuring the transfer settings, connecting to the data source, and saving.\u003c/p\u003e\n"],["\u003cp\u003eTransferred data is written to ingestion-time partitioned tables in BigQuery, which requires using the \u003ccode\u003e_PARTITIONTIME\u003c/code\u003e pseudocolumn when querying directly.\u003c/p\u003e\n"]]],[],null,["# Use third party transfers\n=========================\n\nThird party transfers for BigQuery Data Transfer Service allow you to automatically\nschedule and manage recurring load jobs for external data sources such as\nSalesforce CRM, Adobe Analytics, and Facebook Ads.\n\nBefore you begin\n----------------\n\nBefore you create a third party data transfer:\n\n- Verify that you have completed all actions required to [enable the BigQuery Data Transfer Service](/bigquery/docs/enable-transfer-service).\n- [Create a BigQuery dataset](/bigquery/docs/datasets) to store the data.\n- Ensure that the person creating the transfer has the following required\n permissions in BigQuery:\n\n - `bigquery.transfers.update` permissions to create the transfer\n - Both `bigquery.datasets.get` and `bigquery.datasets.update` permissions on the target dataset\n\n The `bigquery.admin` predefined IAM role\n includes `bigquery.transfers.update`, `bigquery.datasets.update` and\n `bigquery.datasets.get` permissions. For more information on\n IAM roles in BigQuery Data Transfer Service, see\n [Access control](/bigquery/docs/access-control).\n- Consult the documentation for your third party data source to ensure you have\n configured any permissions necessary to enable the transfer.\n\n- If you intend to setup transfer run notifications for Pub/Sub, you\n must have `pubsub.topics.setIamPolicy` permissions. Pub/Sub\n permissions are not required if you just set up email notifications. For more\n information, see\n [BigQuery Data Transfer Service run notifications](/bigquery/docs/transfer-run-notifications).\n\nLimitations\n-----------\n\nThird party transfers are subject to the following limitations:\n\n- You must create or update a third party transfer by using the Google Cloud console.\n- Currently, you cannot configure or update a third party transfers by using the bq command-line tool.\n\nSet up a third party data transfer\n----------------------------------\n\nTo create a third party data transfer by using the Google Cloud console:\n\n1. Go to the Google Cloud Marketplace.\n\n [Go to the Google Cloud Marketplace](https://console.cloud.google.com/marketplace/browse?filter=category:data-transfer-services)\n2. Click the appropriate third party provider.\n\n3. On the documentation page for the third party provider, click\n **Enroll**. The enrollment process may take a moment.\n\n4. After the enrollment is complete, click **Configure Transfer**.\n\n5. On the **Create Transfer** page:\n\n - For **Source** , choose the appropriate third party data source. You can\n click **Explore Data Sources** to see the list of third party providers\n in the Google Cloud Marketplace.\n\n - For **Display name** , enter a name for the transfer such as `My Transfer`.\n The transfer name can be any value that allows you to easily identify the\n transfer if you need to modify it later.\n\n - For **Schedule** , leave the default value (**Start now** ) or click\n **Start at a set time**.\n\n - For **Repeats**, choose an option for how often to run the transfer.\n Options include:\n\n - Daily (default)\n - Weekly\n - Monthly\n - Custom\n - On-demand\n\n If you choose an option other than Daily, additional options are\n available. For example, if you choose Weekly, an option appears for\n you to select the day of the week.\n - For **Start date and run time** , enter the date and time to start the\n transfer. If you choose **Start now**, this option is disabled.\n\n - For **Destination dataset**, choose the dataset you created to store your\n data.\n\n - (Optional) In the **Notification options** section:\n\n - Click the toggle to enable email notifications. When you enable this option, the transfer administrator receives an email notification when a transfer run fails.\n - For **Select a Pub/Sub topic** , choose your [topic](/pubsub/docs/overview#types) name or click **Create a topic** to create one. This option configures Pub/Sub run [notifications](/bigquery/docs/transfer-run-notifications) for your transfer.\n6. Click **Connect Source**.\n\n | **Note:** If you did not select a destination dataset, clicking **Connect\n | Source** produces the following error: `A selected destination dataset is\n | required before connecting to the source.`\n7. When prompted, click **Accept** to give the BigQuery Data Transfer Service permission\n to connect to the data source and to manage your data in\n BigQuery.\n\n8. Follow the instructions in the subsequent pages to configure the connection\n to your external data source.\n\n9. After you complete the configuration steps, click **Save**.\n\nTroubleshoot third party transfer setup\n---------------------------------------\n\nIf you are having issues setting up your transfer, consult the appropriate third\nparty vendor. Contact information is available on the transfer's documentation\npage in the Google Cloud Marketplace.\n\nQuery your data\n---------------\n\nWhen your data is transferred to BigQuery, the data is\nwritten to ingestion-time partitioned tables. For more information, see\n[Introduction to partitioned tables](/bigquery/docs/partitioned-tables).\n\nIf you query your tables directly instead of using the auto-generated views, you\nmust use the `_PARTITIONTIME` pseudocolumn in your query. For more information,\nsee [Querying partitioned tables](/bigquery/docs/querying-partitioned-tables).\n\nWhat's next\n-----------\n\n- For an overview of BigQuery Data Transfer Service, see [Introduction to BigQuery Data Transfer Service](/bigquery/docs/dts-introduction).\n- For information on using transfers including getting information about a transfer configuration, listing transfer configurations, and viewing a transfer's run history, see [Working with transfers](/bigquery/docs/working-with-transfers)."]]
