[victorialogs] unexpected stream filter behavior

[francisye19]

Describe the bug

In some cases, a query of combination of stream filter and logic filter doesn't return expected results.

Ingested log: {"A": "a", "B": "b", "C": "c", "_msg":"message"}, A and B are stream fields, and C is other field
Query: _stream:{A="a"} AND _stream:{B="b"}
Expected: return the ingested log
Actual: return nothing

To Reproduce

test data

echo '{"A": "a", "B": "b", "C": "c", "_msg":"message"}' | curl -XPOST -H 'Content-Type: application/stream+json' --data-binary @- 'http://localhost:9428/insert/jsonline?_stream_fields=A,B'

query results

# query1 - returns nothing(unexpected)
curl -s http://localhost:9428/select/logsql/query --data-urlencode 'query=_stream:{A="a"} AND _stream:{B="b"}'

# query2 - does return the log
curl -s http://localhost:9428/select/logsql/query --data-urlencode 'query=(_stream:{A="a"} AND _stream:{B="b"}) AND C:c'
{"_time":"2024-05-19T12:22:44.691982867Z","_stream":"{A=\"a\",B=\"b\"}","_msg":"message","A":"a","B":"b","C":"c"}

Version

v0.7.0-victorialogs

Logs

No response

Screenshots

No response

Used command-line flags

No response

Additional information

It seems the reason is searchStreamIDs can't get correct streamIDs.

[francisye19]

Hi, @valyala, PTAL this line. Should initStreamFilters take so.tenantIDs instead of tenantIDs? tenantIDs is set to nil when a common stream filter exists, so tenantIDs is not properly set for stream filters of f(code), therefore streamIDs cannot be collected correctly later(code).