trying to join two streams using inner join and storing the resultant data into a topic but one of the column is missing in topic schema

0 votes
Source Streams:

CREATE STREAM one ( ADC_ID BIGINT, ETL_DATATYPE VARCHAR(400)) WITH(KAFKA_TOPIC ='AMM_DATATYPE_CONVERSION',PARTITIONS=1,REPLICAS=1, VALUE_FORMAT='AVRO');

CREATE STREAM two ( ADT_ID BIGINT KEY,DATATYPE VARCHAR(400)) WITH(KAFKA_TOPIC ='AMM_DATATYPES',PARTITIONS=1,REPLICAS=1, VALUE_FORMAT='AVRO');

Target Stream:

CREATE STREAM TargetStream WITH (KAFKA_TOPIC ='TestTopic', VALUE_FORMAT='AVRO', PARTITIONS=3 )
AS SELECT CONCAT_WS('',one.ETL_DATATYPE,two.DATATYPE) AS ADDRESS,
one.ADC_ID as ADCID, one.ETL_DATATYPE as ETLDATATYPE, two.ADT_ID as ADTID
from one inner join two WITHIN 1 DAY on one.ADC_ID=two.ADT_ID EMIT CHANGES LIMIT 3;

here in this example ADCID column is missing in TestTopic.
May 1, 2021 in Apache Kafka by anonymous

edited Mar 4, 2025 795 views

No answer to this question. Be the first to respond.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP