最新のCertified-Data-Engineer-Professional問題集で試験を準備する

A data team's Structured Streaming job is configured to calculate running aggregates for item sales to update a downstream marketing dashboard. The marketing team has introduced a new field to track the number of times this promotion code is used for each item. A junior data engineer suggests updating the existing query as follows: Note that proposed changes are in bold.
Original query:

Proposed query:

Which step must also be completed to put the proposed query into production?

• A. Register the data in the "/item_agg" directory to the Hive metastore
• B. Run REFRESH TABLE delta, /item_agg'
• C. Specify a new checkpointlocation
• D. Increase the shuffle partitions to account for additional aggregates
• E. Remove .option (mergeSchema', true') from the streaming write

Which statement characterizes the general programming model used by Spark Structured Streaming?

• A. Structured Streaming leverages the parallel processing of GPUs to achieve highly parallel data throughput.
• B. Structured Streaming uses specialized hardware and I/O streams to achieve sub-second latency for data transfer.
• C. Structured Streaming relies on a distributed network of nodes that hold incremental state values for cached stages.
• D. Structured Streaming is implemented as a messaging bus and is derived from Apache Kafka.
• E. Structured Streaming models new data arriving in a data stream as new rows appended to an unbounded table.

The data governance team has instituted a requirement that the "user" table containing Personal Identifiable Information (PII) must have the appropriate masking on the SSN column. This means that anyone outside of the HRAdminGroup should see masked social security numbers as ***-**-
****.
The team created a masking function:

What does the data governance team need to do next to achieve this goal?

• A. CREATE TABLE users
  (name STRING);
  ALTER TABLE users CREATE COLUMN ssn CREATE MASK ssn_mask;
• B. CREATE TABLE users
  (name STRING, int STRING);
  ALTER TABLE users ALTER COLUMN ssn CREATE MASK if is_member('HRAdminGroup');
• C. CREATE TABLE users
  (name STRING, ssn STRING);
  ALTER TABLE users ALTER COLUMN ssn SET MASK ssn_mask;
• D. CREATE TABLE users
  (name STRING, ssn INT MASKED ssn_mask);

A data engineer is configuring Delta Sharing for a Databricks-to-Databricks scenario to optimize read performance. The recipient needs to perform time travel queries and streaming reads on shared sales data. Which configuration will provide the optimal performance while enabling these capabilities?

• A. Use the open sharing protocol instead of Databricks-to-Databricks sharing for better performance.
• B. Share tables WITH HISTORY, ensure tables don't have partitioning enabled, and enable CDF before sharing.
• C. Share the entire schema WITHOUT HISTORY and rely on recipient-side caching for performance.
• D. Share tables WITHOUT HISTORY and enable partitioning for better query performance.

A data engineer is testing a collection of mathematical functions, one of which calculates the area under a curve as described by another function.
assert(myIntegrate(lambda x: x*x, 0, 3) [0] == 9)
Which kind of the test does the above line exemplify?

• A. End-to-end
• B. Manual
• C. functional
• D. Unit
• E. Integration