Dears,
I need your help , i need to create a product this product will make the user enter a domain/email and the system will return the results that are related to the value that is entered by a user.
My product/platform will have more than 5000 Text files in multi-format content (i.e some files the content will be line by line, others will be comma by comma ..etc) and I have more than 1000 .SQL files (Database files).
The expected size for the files (txt & SQL ) is approx 5 terabytes.
So what is your recommendation, what I should use in my product? i.e how can I do a collective with my all files?
Must use a Syslog/Siem-like elastic search/OpenSearch to do that? or something else.
Please advise me.