Interface LineageGrpc.AsyncService (0.38.0)

public static interface LineageGrpc.AsyncService

Lineage is used to track data flows between assets over time. You can create LineageEvents to record lineage between multiple sources and a single target, for example, when table data is based on data from multiple tables.

Methods

batchSearchLinkProcesses(BatchSearchLinkProcessesRequest request, StreamObserver<BatchSearchLinkProcessesResponse> responseObserver)

public default void batchSearchLinkProcesses(BatchSearchLinkProcessesRequest request, StreamObserver<BatchSearchLinkProcessesResponse> responseObserver)

Retrieve information about LineageProcesses associated with specific links. LineageProcesses are transformation pipelines that result in data flowing from source to target assets. Links between assets represent this operation. If you have specific link names, you can use this method to verify which LineageProcesses contribute to creating those links. See the SearchLinks method for more information on how to retrieve link name. You can retrieve the LineageProcess information in every project where you have the datalineage.events.get permission. The project provided in the URL is used for Billing and Quota.

Parameters
Name Description
request BatchSearchLinkProcessesRequest
responseObserver io.grpc.stub.StreamObserver<BatchSearchLinkProcessesResponse>

createLineageEvent(CreateLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

public default void createLineageEvent(CreateLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

Creates a new lineage event.

Parameters
Name Description
request CreateLineageEventRequest
responseObserver io.grpc.stub.StreamObserver<LineageEvent>

createProcess(CreateProcessRequest request, StreamObserver<Process> responseObserver)

public default void createProcess(CreateProcessRequest request, StreamObserver<Process> responseObserver)

Creates a new process.

Parameters
Name Description
request CreateProcessRequest
responseObserver io.grpc.stub.StreamObserver<Process>

createRun(CreateRunRequest request, StreamObserver<Run> responseObserver)

public default void createRun(CreateRunRequest request, StreamObserver<Run> responseObserver)

Creates a new run.

Parameters
Name Description
request CreateRunRequest
responseObserver io.grpc.stub.StreamObserver<Run>

deleteLineageEvent(DeleteLineageEventRequest request, StreamObserver<Empty> responseObserver)

public default void deleteLineageEvent(DeleteLineageEventRequest request, StreamObserver<Empty> responseObserver)

Deletes the lineage event with the specified name.

Parameters
Name Description
request DeleteLineageEventRequest
responseObserver io.grpc.stub.StreamObserver<Empty>

deleteProcess(DeleteProcessRequest request, StreamObserver<Operation> responseObserver)

public default void deleteProcess(DeleteProcessRequest request, StreamObserver<Operation> responseObserver)

Deletes the process with the specified name.

Parameters
Name Description
request DeleteProcessRequest
responseObserver io.grpc.stub.StreamObserver<Operation>

deleteRun(DeleteRunRequest request, StreamObserver<Operation> responseObserver)

public default void deleteRun(DeleteRunRequest request, StreamObserver<Operation> responseObserver)

Deletes the run with the specified name.

Parameters
Name Description
request DeleteRunRequest
responseObserver io.grpc.stub.StreamObserver<Operation>

getLineageEvent(GetLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

public default void getLineageEvent(GetLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

Gets details of a specified lineage event.

Parameters
Name Description
request GetLineageEventRequest
responseObserver io.grpc.stub.StreamObserver<LineageEvent>

getProcess(GetProcessRequest request, StreamObserver<Process> responseObserver)

public default void getProcess(GetProcessRequest request, StreamObserver<Process> responseObserver)

Gets the details of the specified process.

Parameters
Name Description
request GetProcessRequest
responseObserver io.grpc.stub.StreamObserver<Process>

getRun(GetRunRequest request, StreamObserver<Run> responseObserver)

public default void getRun(GetRunRequest request, StreamObserver<Run> responseObserver)

Gets the details of the specified run.

Parameters
Name Description
request GetRunRequest
responseObserver io.grpc.stub.StreamObserver<Run>

listLineageEvents(ListLineageEventsRequest request, StreamObserver<ListLineageEventsResponse> responseObserver)

public default void listLineageEvents(ListLineageEventsRequest request, StreamObserver<ListLineageEventsResponse> responseObserver)

Lists lineage events in the given project and location. The list order is not defined.

Parameters
Name Description
request ListLineageEventsRequest
responseObserver io.grpc.stub.StreamObserver<ListLineageEventsResponse>

listProcesses(ListProcessesRequest request, StreamObserver<ListProcessesResponse> responseObserver)

public default void listProcesses(ListProcessesRequest request, StreamObserver<ListProcessesResponse> responseObserver)

List processes in the given project and location. List order is descending by insertion time.

Parameters
Name Description
request ListProcessesRequest
responseObserver io.grpc.stub.StreamObserver<ListProcessesResponse>

listRuns(ListRunsRequest request, StreamObserver<ListRunsResponse> responseObserver)

public default void listRuns(ListRunsRequest request, StreamObserver<ListRunsResponse> responseObserver)

Lists runs in the given project and location. List order is descending by start_time.

Parameters
Name Description
request ListRunsRequest
responseObserver io.grpc.stub.StreamObserver<ListRunsResponse>

processOpenLineageRunEvent(ProcessOpenLineageRunEventRequest request, StreamObserver<ProcessOpenLineageRunEventResponse> responseObserver)

public default void processOpenLineageRunEvent(ProcessOpenLineageRunEventRequest request, StreamObserver<ProcessOpenLineageRunEventResponse> responseObserver)

Creates new lineage events together with their parents: process and run. Updates the process and run if they already exist. Mapped from Open Lineage specification: https://github.com/OpenLineage/OpenLineage/blob/main/spec/OpenLineage.json.

Parameters
Name Description
request ProcessOpenLineageRunEventRequest
responseObserver io.grpc.stub.StreamObserver<ProcessOpenLineageRunEventResponse>
public default void searchLinks(SearchLinksRequest request, StreamObserver<SearchLinksResponse> responseObserver)

Retrieve a list of links connected to a specific asset. Links represent the data flow between source (upstream) and target (downstream) assets in transformation pipelines. Links are stored in the same project as the Lineage Events that create them. You can retrieve links in every project where you have the datalineage.events.get permission. The project provided in the URL is used for Billing and Quota.

Parameters
Name Description
request SearchLinksRequest
responseObserver io.grpc.stub.StreamObserver<SearchLinksResponse>

updateProcess(UpdateProcessRequest request, StreamObserver<Process> responseObserver)

public default void updateProcess(UpdateProcessRequest request, StreamObserver<Process> responseObserver)

Updates a process.

Parameters
Name Description
request UpdateProcessRequest
responseObserver io.grpc.stub.StreamObserver<Process>

updateRun(UpdateRunRequest request, StreamObserver<Run> responseObserver)

public default void updateRun(UpdateRunRequest request, StreamObserver<Run> responseObserver)

Updates a run.

Parameters
Name Description
request UpdateRunRequest
responseObserver io.grpc.stub.StreamObserver<Run>