Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Increase scan size limit for large queries #45729

Open
yuanzhangjun opened this issue May 16, 2024 · 2 comments
Open

[Feature Request] Increase scan size limit for large queries #45729

yuanzhangjun opened this issue May 16, 2024 · 2 comments

Comments

@yuanzhangjun
Copy link

yuanzhangjun commented May 16, 2024

Feature request

At present, there are three major query limitations for SR, but none of them fully meet our limitation requirements. We hope to limit them based on the size of the scan volume (scanbytes), which is more effective than scanning the number of rows.

##at present
big_query_cpu_second_limit
big_query_scan_rows_limit
big_query_mem_limit

##Describe the solution you'd like
add big_query_scan_bytes_limit ?

@yuanzhangjun yuanzhangjun changed the title Increase scan size limit for large queries [Feature Request]Increase scan size limit for large queries May 16, 2024
@yuanzhangjun yuanzhangjun changed the title [Feature Request]Increase scan size limit for large queries [Feature Request] Increase scan size limit for large queries May 16, 2024
@Dshadowzh
Copy link
Contributor

Thx for you advice. Both big_query_scan_rows_limit and big_query_scan_bytes_limit are an estimation for big query, Can you tell how do you choose big_query_scan_bytes_limit rather than big_query_scan_rows_limit?

@yuanzhangjun
Copy link
Author

Thx for you advice. Both big_query_scan_rows_limit and big_query_scan_bytes_limit are an estimation for big query, Can you tell how do you choose big_query_scan_bytes_limit rather than big_query_scan_rows_limit?

For column storage, when I scan a large number of rows with few fields, the required resources are not significant, for example: select count (1) from t. If it is big_query_scan_rows_limit, then this SQL will be restricted. Therefore, I hope to adjust large queries based on scan size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants