loading click-ingest with data

script.sh

 kcat -b localhost:29092 -t catchall_legacy -P -l test_events.jsonl

test_events.jsonl

{"timestamp": 1696964534, "id": "0", "account": {"id": "000000001"}, "recipient": "test1@gmail.com", "event": "delivered"}
{"timestamp": 1696964535, "id": "1", "account": {"id": "000000001"}, "recipient": "test1@gmail.com", "event": "delivered"}
{"timestamp": 1697040168, "id": "2", "account": {"id": "000000001"}, "recipient": "test2@gmail.com", "event": "delivered"}
{"timestamp": 1697050168, "id": "3", "account": {"id": "000000002"}, "recipient": "test1@gmail.com", "event": "delivered"}
{"timestamp": 1697053778, "id": "4", "account": {"id": "000000002"}, "recipient": "test1@gmail.com", "event": "delivered"}
{"timestamp": 1697057388, "id": "5", "account": {"id": "000000002"}, "recipient": "test1@gmail.com", "event": "delivered"}
{"timestamp": 1697040168, "id": "6", "account": {"id": "000000002"}, "recipient": "test2@gmail.com", "event": "delivered"}
{"timestamp": 1696940168, "id": "7", "account": {"id": "000000002"}, "recipient": "test2@gmail.com", "event": "delivered"}
{"timestamp": 1697050268, "id": "3", "account": {"id": "000000002"}, "recipient": "test1@gmail.com", "event": "opened"}
{"timestamp": 1697050278, "id": "3", "account": {"id": "000000002"}, "recipient": "test1@gmail.com", "event": "clicked"}
{"timestamp": 1697060168, "id": "1", "account": {"id": "000000001"}, "recipient": "test1@gmail.com", "event": "opened"}
{"timestamp": 1697120168, "id": "2", "account": {"id": "000000001"}, "recipient": "test2@gmail.com", "event": "opened"}
{"timestamp": 1697120178, "id": "2", "account": {"id": "000000001"}, "recipient": "test2@gmail.com", "event": "clicked"}
{"timestamp": 1697120168, "id": "2", "account": {"id": "000000001"}, "recipient": "test2@gmail.com", "event": "opened"}
{"timestamp": 1697120179, "id": "6", "account": {"id": "000000001"}, "recipient": "test2@gmail.com", "event": "clicked"}
{"timestamp": 1697120169, "id": "6", "account": {"id": "000000001"}, "recipient": "test2@gmail.com", "event": "opened"}
{"timestamp": 1696940168, "id": "7", "account": {"id": "000000002"}, "recipient": "test2@gmail.com", "event": "opened"}

Hit staging with a pipeline event: kcat -b kafka-001.node.staging.mailforce:9092 -t use4_pipeline_events -P -l pipeline.jsonl

local: kcat -b localhost:29092 -t catchall_legacy -P -l pipeline.jsonl