Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Got 'TOO LARGE SIZE' when select from odbc table. Is there new settings for this? #64087

Open
alexsubota opened this issue May 18, 2024 · 4 comments
Labels
question Question? st-need-info We need extra data to continue (waiting for response)

Comments

@alexsubota
Copy link

clickhouse v.24.3.3.102

create table mytable
(
    mycolumn String,
    ....
    ....
) engine ODBC(....);

select * from mytable;
--HTTP status code: 500 Internal Server Error, body: ��Code: 49. DB::Exception: Too large size (18446464152236284704) 
--passed to allocator. It indicates an error.: While executing ODBC. (LOGICAL_ERROR),. 
--(RECEIVED_ERROR_FROM_REMOTE_IO_SERVER) (version 24.3.3.102 (official build))

But it works when i try to select only less number of columns. Is there new settings for this?
On v.24.2 it works well
Also, it works well when i select from odbc table function instead of odbc engine

@alexsubota alexsubota added the question Question? label May 18, 2024
@nikitamikhaylov
Copy link
Member

This is a logical error and very concerning. Please try to find the stacktrace of this error in logs and paste here. Also, please provide more context about which datasource you are trying to connect to.

It would be very nice if you will provide a step-by-step guide on how to reproduce this error.

@alexey-milovidov alexey-milovidov added the st-need-info We need extra data to continue (waiting for response) label May 19, 2024
@alexsubota
Copy link
Author

Where i can find stacktrace?

@Algunenano
Copy link
Member

Where i can find stacktrace?

In the logs. Apart from that, if you could provide a reproducer it'd go a long way into helping whoever investigates the issue

@alexsubota
Copy link
Author

2024.05.21 10:44:22.731127 [ 3309 ] {d1dc1835-9231-407d-ae95-edd1e7fce9b4} <Error> DynamicQueryHandler: Code: 86. DB::HTTPException: Received error from remote server http://127.0.0.1:9018/?use_connection_pooling=1&version=1&connection_string=DSN%3Dpervasive&max_block_size=10. HTTP status code: 500 Internal Server Error, body: ?Code: 49. DB::Exception: Too large size (18446464508685088256) passed to allocator. It indicates an error.: While executing ODBC. (LOGICAL_ERROR), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000777cd5b
1. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x00000000038701b0
2. Allocator<false, false>::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x00000000077564e6
3. void DB::PODArrayBase<16ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000381c447
4. DB::SerializationDecimal<DB::Decimal<wide::integer<128ul, int>>>::deserializeText(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&, bool) const @ 0x0000000003452a97
5. DB::ODBCSource::generate() @ 0x00000000035b5f8b
6. DB::ISource::tryGenerate() @ 0x0000000005217ed5
7. DB::ISource::work() @ 0x0000000005217962
8. DB::ExecutionThreadContext::executeTask() @ 0x0000000005232b7a
9. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000052270d0
10. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000005226541
11. DB::CompletedPipelineExecutor::execute() @ 0x0000000005224c72
12. DB::ODBCHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x00000000035af0d2
13. DB::HTTPServerConnection::run() @ 0x00000000057aaaba
14. Poco::Net::TCPServerConnection::start() @ 0x0000000007962512
15. Poco::Net::TCPServerDispatcher::run() @ 0x0000000007963359
16. Poco::PooledThread::run() @ 0x0000000007a1e601
17. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000007a1cddd
18. ? @ 0x00007f21aa471609
19. ? @ 0x00007f21aa396353
 (version 24.3.3.102 (official build)): (in file/uri http://127.0.0.1:9018/?use_connection_pooling=1&version=1&connection_string=DSN%3Dpervasive&max_block_size=10): While executing BinaryRowInputFormat: While executing ODBC. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cbc851b
1. DB::Exception::Exception<String const&, int, String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int>::type, std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, int&&, String const&, String const&) @ 0x000000000ce56ccc
2. DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x000000000ce56a20
3. DB::assertResponseIsOk(String const&, Poco::Net::HTTPResponse&, std::basic_istream<char, std::char_traits<char>>&, bool) @ 0x000000000ce56923
4. DB::ReadWriteBufferFromHTTP::callImpl(Poco::Net::HTTPResponse&, String const&, std::optional<DB::ReadWriteBufferFromHTTP::HTTPRange> const&, bool) const @ 0x000000000e5fa4ca
5. DB::ReadWriteBufferFromHTTP::callWithRedirects(Poco::Net::HTTPResponse&, String const&, std::optional<DB::ReadWriteBufferFromHTTP::HTTPRange> const&) @ 0x000000000e5fa757
6. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReadWriteBufferFromHTTP::nextImpl()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000000e5fd113
7. DB::ReadWriteBufferFromHTTP::doWithRetries(std::function<void ()>&&, std::function<void ()>, bool) const @ 0x000000000e5f7d9b
8. DB::ReadWriteBufferFromHTTP::nextImpl() @ 0x000000000e5fba5f
9. DB::FormatWithNamesAndTypesReader::checkForSuffix() @ 0x0000000012476344
10. DB::RowInputFormatWithNamesAndTypes::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x0000000012479e54
11. DB::IRowInputFormat::read() @ 0x000000001243fd9c
12. DB::IInputFormat::generate() @ 0x00000000123d6c36
13. DB::ISource::tryGenerate() @ 0x00000000123b2615
14. DB::ISource::work() @ 0x00000000123b20a2
15. DB::ExecutionThreadContext::executeTask() @ 0x00000000123cd2da
16. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000123c1830
17. DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x00000000123c1248
18. DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x00000000123d1077
19. DB::StorageURLSource::generate() @ 0x0000000011a21bf8
20. DB::ISource::tryGenerate() @ 0x00000000123b2615
21. DB::ISource::work() @ 0x00000000123b20a2
22. DB::ExecutionThreadContext::executeTask() @ 0x00000000123cd2da
23. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000123c1830
24. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000123c0ca1
25. DB::CompletedPipelineExecutor::execute() @ 0x00000000123bf432
26. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x0000000011273ddb
27. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x00000000122f0075
28. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x00000000122f4b34
29. DB::HTTPServerConnection::run() @ 0x00000000123740da
30. Poco::Net::TCPServerConnection::start() @ 0x0000000014c9b8d2
31. Poco::Net::TCPServerDispatcher::run() @ 0x0000000014c9c719
 (version 24.3.3.102 (official build))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Question? st-need-info We need extra data to continue (waiting for response)
Projects
None yet
Development

No branches or pull requests

4 participants