gistfile1.txt

2025.11.04 17:07:53.807149 [ 85 ] {} <Fatal> BaseDaemon: ########## Short fault info ############
2025.11.04 17:07:53.807172 [ 85 ] {} <Fatal> BaseDaemon: (version 25.10.1.3832 (official build), build id: 45E84B04E418D6507C86CB91B5011CB334F3E8F3, git hash: f95c1af632a1c4fb9c69a501d05ae04a393b8f81, architecture: x86_64) (from thread 846) Received signal 11
2025.11.04 17:07:53.807180 [ 85 ] {} <Fatal> BaseDaemon: Signal description: Segmentation fault
2025.11.04 17:07:53.807187 [ 85 ] {} <Fatal> BaseDaemon: Address: 0x30. Access: read. Address not mapped to object.
2025.11.04 17:07:53.807199 [ 85 ] {} <Fatal> BaseDaemon: Stack trace: 0x000000001ab0ae12 0x000000001ab08bc2 0x000000001aab321a 0x000000001aac73f9 0x000000001aaccb4f 0x000000001aa2bf79 0x000000001aa77280 0x0000000018938999 0x000000001893845e 0x0000000018d0de04 0x0000000018d14a0d 0x000000001a3bfb28 0x000000001a3c48a4 0x000000001a49dd33 0x000000001f54aa87 0x000000001f54af19 0x000000001f5116c7 0x000000001f50fac1 0x00007f412e9c6ac3 0x00007f412ea57a74
2025.11.04 17:07:53.807205 [ 85 ] {} <Fatal> BaseDaemon: ########################################
2025.11.04 17:07:53.807218 [ 85 ] {} <Fatal> BaseDaemon: (version 25.10.1.3832 (official build), build id: 45E84B04E418D6507C86CB91B5011CB334F3E8F3, git hash: f95c1af632a1c4fb9c69a501d05ae04a393b8f81) (from thread 846) (query_id: 099f60c9-5a0d-4c52-b9d3-f44df832e8a2) (query: WITH all_inference_ids AS (SELECT DISTINCT inference_id FROM TagInference FINAL WHERE (key = 'tensorzero::datapoint_id') AND (value = '0195d806-e43d-7f7e-bb05-f6dd0d95846f') AND (function_name = 'write_haiku')), filtered_inference AS (SELECT * FROM ChatInference WHERE (id IN (SELECT inference_id FROM all_inference_ids)) AND (function_name = 'write_haiku') AND ((tags['tensorzero::evaluation_run_id']) IN _CAST(['0195aef7-96fe-7d60-a2e6-5a6ea990c425'], 'Array(String)'))), filtered_feedback AS (SELECT target_id, metric_name, argMax(toString(value), timestamp) AS value, argMax(tags['tensorzero::evaluator_inference_id'], timestamp) AS evaluator_inference_id, argMax(id, timestamp) AS feedback_id, argMax(tags['tensorzero::human_feedback'], timestamp) = 'true' AS is_human_feedback FROM BooleanMetricFeedback WHERE (metric_name IN _CAST(['tensorzero::evaluation_name::haiku::evaluator_name::topic_starts_with_f', 'tensorzero::evaluation_name::haiku::evaluator_name::exact_match'], 'Array(String)')) AND (target_id IN (SELECT inference_id FROM all_inference_ids)) GROUP BY target_id, metric_name UNION ALL SELECT target_id, metric_name, argMax(toString(value), timestamp) AS value, argMax(tags['tensorzero::evaluator_inference_id'], timestamp) AS evaluator_inference_id, argMax(id, timestamp) AS feedback_id, argMax(tags['tensorzero::human_feedback'], timestamp) = 'true' AS is_human_feedback FROM FloatMetricFeedback WHERE (metric_name IN _CAST(['tensorzero::evaluation_name::haiku::evaluator_name::topic_starts_with_f', 'tensorzero::evaluation_name::haiku::evaluator_name::exact_match'], 'Array(String)')) AND (target_id IN (SELECT inference_id FROM all_inference_ids)) GROUP BY target_id, metric_name), filtered_datapoint AS (SELECT * FROM ChatInferenceDatapoint FINAL WHERE (id = _CAST('0195d806-e43d-7f7e-bb05-f6dd0d95846f', 'UUID')) AND (function_name = 'write_haiku')) SELECT filtered_inference.input AS input, filtered_inference.tags['tensorzero::datapoint_id'] AS datapoint_id, filtered_datapoint.name AS name, filtered_datapoint.output AS reference_output, filtered_inference.id AS inference_id, filtered_inference.episode_id AS episode_id, filtered_inference.output AS generated_output, filtered_inference.tags['tensorzero::evaluation_run_id'] AS evaluation_run_id, filtered_inference.variant_name AS variant_name, filtered_inference.tags['tensorzero::dataset_name'] AS dataset_name, if(length(filtered_feedback.evaluator_inference_id) > 0, filtered_feedback.evaluator_inference_id, NULL) AS evaluator_inference_id, filtered_feedback.metric_name AS metric_name, filtered_feedback.value AS metric_value, filtered_feedback.feedback_id AS feedback_id, toBool(filtered_feedback.is_human_feedback) AS is_human_feedback, formatDateTime(filtered_datapoint.staled_at, '%Y-%m-%dT%H:%i:%SZ') AS staled_at FROM filtered_inference INNER JOIN filtered_datapoint ON filtered_datapoint.id = toUUIDOrNull(filtered_inference.tags['tensorzero::datapoint_id']) LEFT JOIN filtered_feedback ON filtered_feedback.target_id = filtered_inference.id FORMAT JSONEachRow) Received signal Segmentation fault (11)
2025.11.04 17:07:53.807221 [ 85 ] {} <Fatal> BaseDaemon: Address: 0x30. Access: read. Address not mapped to object.
2025.11.04 17:07:53.807225 [ 85 ] {} <Fatal> BaseDaemon: Stack trace: 0x000000001ab0ae12 0x000000001ab08bc2 0x000000001aab321a 0x000000001aac73f9 0x000000001aaccb4f 0x000000001aa2bf79 0x000000001aa77280 0x0000000018938999 0x000000001893845e 0x0000000018d0de04 0x0000000018d14a0d 0x000000001a3bfb28 0x000000001a3c48a4 0x000000001a49dd33 0x000000001f54aa87 0x000000001f54af19 0x000000001f5116c7 0x000000001f50fac1 0x00007f412e9c6ac3 0x00007f412ea57a74
2025.11.04 17:07:53.807430 [ 85 ] {} <Fatal> BaseDaemon: 2. (anonymous namespace)::splitPartsRanges(DB::RangesInDataParts, bool, std::shared_ptr<Poco::Logger> const&) @ 0x000000001ab0ae12
2025.11.04 17:07:53.807455 [ 85 ] {} <Fatal> BaseDaemon: 3. DB::splitPartsWithRangesByPrimaryKey(DB::KeyDescription const&, DB::KeyDescription const&, std::shared_ptr<DB::ExpressionActions>, DB::RangesInDataParts, unsigned long, std::shared_ptr<DB::Context const>, std::function<DB::Pipe (DB::RangesInDataParts)>&&, bool, bool) @ 0x000000001ab08bc2
2025.11.04 17:07:53.807575 [ 85 ] {} <Fatal> BaseDaemon: 4. DB::ReadFromMergeTree::spreadMarkRangesAmongStreamsFinal(DB::RangesInDataParts&&, std::shared_ptr<DB::MergeTreeIndexBuildContext> const&, unsigned long, std::vector<String, std::allocator<String>> const&, std::vector<String, std::allocator<String>> const&, std::optional<DB::ActionsDAG>&) @ 0x000000001aab321a
2025.11.04 17:07:53.807597 [ 85 ] {} <Fatal> BaseDaemon: 5. DB::ReadFromMergeTree::spreadMarkRanges(DB::RangesInDataParts&&, std::shared_ptr<DB::MergeTreeIndexBuildContext> const&, unsigned long, DB::ReadFromMergeTree::AnalysisResult&, std::optional<DB::ActionsDAG>&) @ 0x000000001aac73f9
2025.11.04 17:07:53.807610 [ 85 ] {} <Fatal> BaseDaemon: 6. DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001aaccb4f
2025.11.04 17:07:53.807625 [ 85 ] {} <Fatal> BaseDaemon: 7. DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001aa2bf79
2025.11.04 17:07:53.807640 [ 85 ] {} <Fatal> BaseDaemon: 8. DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&, bool) @ 0x000000001aa77280
2025.11.04 17:07:53.807657 [ 85 ] {} <Fatal> BaseDaemon: 9. DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x0000000018938999
2025.11.04 17:07:53.807670 [ 85 ] {} <Fatal> BaseDaemon: 10. DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001893845e
2025.11.04 17:07:53.807793 [ 85 ] {} <Fatal> BaseDaemon: 11. DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>&, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::ImplicitTransactionControlExecutor>, std::function<void ()>) @ 0x0000000018d0de04
2025.11.04 17:07:53.807919 [ 85 ] {} <Fatal> BaseDaemon: 12. DB::executeQuery(std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&, String const&, std::shared_ptr<DB::Context const> const&, std::optional<DB::FormatSettings> const&)>, std::function<void ()>, std::function<void ()>) @ 0x0000000018d14a0d
2025.11.04 17:07:53.807948 [ 85 ] {} <Fatal> BaseDaemon: 13. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001a3bfb28
2025.11.04 17:07:53.807961 [ 85 ] {} <Fatal> BaseDaemon: 14. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001a3c48a4
2025.11.04 17:07:53.807976 [ 85 ] {} <Fatal> BaseDaemon: 15. DB::HTTPServerConnection::run() @ 0x000000001a49dd33
2025.11.04 17:07:53.807993 [ 85 ] {} <Fatal> BaseDaemon: 16. Poco::Net::TCPServerConnection::start() @ 0x000000001f54aa87
2025.11.04 17:07:53.808021 [ 85 ] {} <Fatal> BaseDaemon: 17. Poco::Net::TCPServerDispatcher::run() @ 0x000000001f54af19
2025.11.04 17:07:53.808035 [ 85 ] {} <Fatal> BaseDaemon: 18. Poco::PooledThread::run() @ 0x000000001f5116c7
2025.11.04 17:07:53.808048 [ 85 ] {} <Fatal> BaseDaemon: 19. Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001f50fac1
2025.11.04 17:07:53.808074 [ 85 ] {} <Fatal> BaseDaemon: 20. ? @ 0x0000000000094ac3
2025.11.04 17:07:53.808086 [ 85 ] {} <Fatal> BaseDaemon: 21. ? @ 0x0000000000125a74
2025.11.04 17:07:54.147605 [ 85 ] {} <Fatal> BaseDaemon: Integrity check of the executable successfully passed (checksum: D2257C9B518D9C600C5C2E86DADFFBCB)
2025.11.04 17:07:55.424721 [ 85 ] {} <Fatal> BaseDaemon: Report this error to https://github.com/ClickHouse/ClickHouse/issues
2025.11.04 17:07:55.424969 [ 85 ] {} <Fatal> BaseDaemon: Changed settings: parallel_replicas_for_cluster_engines = false
2025.11.04 17:07:55.425014 [ 85 ] {} <Fatal> BaseDaemon: ########## Short fault info ############
2025.11.04 17:07:55.425025 [ 85 ] {} <Fatal> BaseDaemon: (version 25.10.1.3832 (official build), build id: 45E84B04E418D6507C86CB91B5011CB334F3E8F3, git hash: f95c1af632a1c4fb9c69a501d05ae04a393b8f81, architecture: x86_64) (from thread 852) Received signal 11
2025.11.04 17:07:55.425029 [ 85 ] {} <Fatal> BaseDaemon: Signal description: Segmentation fault
2025.11.04 17:07:55.425033 [ 85 ] {} <Fatal> BaseDaemon: Address: 0x30. Access: read. Address not mapped to object.
2025.11.04 17:07:55.425037 [ 85 ] {} <Fatal> BaseDaemon: Stack trace: 0x000000001ab0ae12 0x000000001ab08bc2 0x000000001aab321a 0x000000001aac73f9 0x000000001aaccb4f 0x000000001aa2bf79 0x000000001aa77280 0x0000000018938999 0x000000001893845e 0x0000000018d0de04 0x0000000018d14a0d 0x000000001a3bfb28 0x000000001a3c48a4 0x000000001a49dd33 0x000000001f54aa87 0x000000001f54af19 0x000000001f5116c7 0x000000001f50fac1 0x00007f412e9c6ac3 0x00007f412ea57a74
2025.11.04 17:07:55.425046 [ 85 ] {} <Fatal> BaseDaemon: (version 25.10.1.3832 (official build), build id: 45E84B04E418D6507C86CB91B5011CB334F3E8F3, git hash: f95c1af632a1c4fb9c69a501d05ae04a393b8f81) (from thread 852) (query_id: 10289805-3c2c-40ba-9867-b6f3b62b4afb) (query: WITH dataset AS (SELECT 'chat' AS type, dataset_name, function_name, name, id, episode_id, input, output, tool_params, '' AS output_schema, tags, auxiliary, source_inference_id, is_deleted, is_custom, staled_at, formatDateTime(updated_at, '%Y-%m-%dT%H:%i:%SZ') AS updated_at FROM ChatInferenceDatapoint AS i FINAL WHERE true AND (dataset_name = 'test') AND (id IN ['01960832-7028-743c-8c44-a598aa5130fd']) AND (staled_at IS NULL) ORDER BY updated_at DESC, id DESC LIMIT _CAST(1, 'UInt32') UNION ALL SELECT 'json' AS type, dataset_name, function_name, name, id, episode_id, input, output, '' AS tool_params, output_schema, tags, auxiliary, source_inference_id, is_deleted, is_custom, staled_at, formatDateTime(updated_at, '%Y-%m-%dT%H:%i:%SZ') AS updated_at FROM JsonInferenceDatapoint AS i FINAL WHERE true AND (dataset_name = 'test') AND (id IN ['01960832-7028-743c-8c44-a598aa5130fd']) AND (staled_at IS NULL) ORDER BY updated_at DESC, id DESC LIMIT _CAST(1, 'UInt32')) SELECT * FROM dataset ORDER BY updated_at DESC, id DESC LIMIT _CAST(0, 'UInt32'), _CAST(1, 'UInt32') FORMAT JSONEachRow) Received signal Segmentation fault (11)
2025.11.04 17:07:55.425048 [ 85 ] {} <Fatal> BaseDaemon: Address: 0x30. Access: read. Address not mapped to object.
2025.11.04 17:07:55.425049 [ 85 ] {} <Fatal> BaseDaemon: Stack trace: 0x000000001ab0ae12 0x000000001ab08bc2 0x000000001aab321a 0x000000001aac73f9 0x000000001aaccb4f 0x000000001aa2bf79 0x000000001aa77280 0x0000000018938999 0x000000001893845e 0x0000000018d0de04 0x0000000018d14a0d 0x000000001a3bfb28 0x000000001a3c48a4 0x000000001a49dd33 0x000000001f54aa87 0x000000001f54af19 0x000000001f5116c7 0x000000001f50fac1 0x00007f412e9c6ac3 0x00007f412ea57a74
2025.11.04 17:07:55.425092 [ 85 ] {} <Fatal> BaseDaemon: 2. (anonymous namespace)::splitPartsRanges(DB::RangesInDataParts, bool, std::shared_ptr<Poco::Logger> const&) @ 0x000000001ab0ae12
2025.11.04 17:07:55.425105 [ 85 ] {} <Fatal> BaseDaemon: 3. DB::splitPartsWithRangesByPrimaryKey(DB::KeyDescription const&, DB::KeyDescription const&, std::shared_ptr<DB::ExpressionActions>, DB::RangesInDataParts, unsigned long, std::shared_ptr<DB::Context const>, std::function<DB::Pipe (DB::RangesInDataParts)>&&, bool, bool) @ 0x000000001ab08bc2
2025.11.04 17:07:55.425116 [ 85 ] {} <Fatal> BaseDaemon: 4. DB::ReadFromMergeTree::spreadMarkRangesAmongStreamsFinal(DB::RangesInDataParts&&, std::shared_ptr<DB::MergeTreeIndexBuildContext> const&, unsigned long, std::vector<String, std::allocator<String>> const&, std::vector<String, std::allocator<String>> const&, std::optional<DB::ActionsDAG>&) @ 0x000000001aab321a
2025.11.04 17:07:55.425121 [ 85 ] {} <Fatal> BaseDaemon: 5. DB::ReadFromMergeTree::spreadMarkRanges(DB::RangesInDataParts&&, std::shared_ptr<DB::MergeTreeIndexBuildContext> const&, unsigned long, DB::ReadFromMergeTree::AnalysisResult&, std::optional<DB::ActionsDAG>&) @ 0x000000001aac73f9
2025.11.04 17:07:55.425125 [ 85 ] {} <Fatal> BaseDaemon: 6. DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001aaccb4f
2025.11.04 17:07:55.425131 [ 85 ] {} <Fatal> BaseDaemon: 7. DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001aa2bf79
2025.11.04 17:07:55.425136 [ 85 ] {} <Fatal> BaseDaemon: 8. DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&, bool) @ 0x000000001aa77280
2025.11.04 17:07:55.425153 [ 85 ] {} <Fatal> BaseDaemon: 9. DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x0000000018938999
2025.11.04 17:07:55.425157 [ 85 ] {} <Fatal> BaseDaemon: 10. DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001893845e
2025.11.04 17:07:55.425166 [ 85 ] {} <Fatal> BaseDaemon: 11. DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>&, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::ImplicitTransactionControlExecutor>, std::function<void ()>) @ 0x0000000018d0de04
2025.11.04 17:07:55.425174 [ 85 ] {} <Fatal> BaseDaemon: 12. DB::executeQuery(std::unique_ptr<DB::ReadBuffer, std::default_delete<DB::ReadBuffer>>, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&, String const&, std::shared_ptr<DB::Context const> const&, std::optional<DB::FormatSettings> const&)>, std::function<void ()>, std::function<void ()>) @ 0x0000000018d14a0d
2025.11.04 17:07:55.425181 [ 85 ] {} <Fatal> BaseDaemon: 13. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001a3bfb28
2025.11.04 17:07:55.425189 [ 85 ] {} <Fatal> BaseDaemon: 14. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001a3c48a4
2025.11.04 17:07:55.425194 [ 85 ] {} <Fatal> BaseDaemon: 15. DB::HTTPServerConnection::run() @ 0x000000001a49dd33
2025.11.04 17:07:55.425200 [ 85 ] {} <Fatal> BaseDaemon: 16. Poco::Net::TCPServerConnection::start() @ 0x000000001f54aa87
2025.11.04 17:07:55.425203 [ 85 ] {} <Fatal> BaseDaemon: 17. Poco::Net::TCPServerDispatcher::run() @ 0x000000001f54af19
2025.11.04 17:07:55.425207 [ 85 ] {} <Fatal> BaseDaemon: 18. Poco::PooledThread::run() @ 0x000000001f5116c7
2025.11.04 17:07:55.425210 [ 85 ] {} <Fatal> BaseDaemon: 19. Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001f50fac1
2025.11.04 17:07:55.425227 [ 85 ] {} <Fatal> BaseDaemon: 20. ? @ 0x0000000000094ac3
2025.11.04 17:07:55.425230 [ 85 ] {} <Fatal> BaseDaemon: 21. ? @ 0x0000000000125a74
2025.11.04 17:07:55.599501 [ 85 ] {} <Fatal> BaseDaemon: Integrity check of the executable successfully passed (checksum: D2257C9B518D9C600C5C2E86DADFFBCB)
2025.11.04 17:07:56.523434 [ 85 ] {} <Fatal> BaseDaemon: Report this error to https://github.com/ClickHouse/ClickHouse/issues
2025.11.04 17:07:56.523607 [ 85 ] {} <Fatal> BaseDaemon: Changed settings: alter_sync = 2, mutations_sync = 2, input_format_skip_unknown_fields = false, input_format_null_as_default = false, output_format_json_quote_64bit_integers = true