BlockingCollection Paged to Disk

Viewed 43

I have read about BigQueue and the like to be a durable disk bound queue.

Is there anything for c# that is not durable but "pages" queue overflow to disk.

I have incoming byte[] after incoming byte[] and don't want to overload the memory. BlockingCollection is ideal because it allows me to have a processing thread and GetConsumingEnumerable(),

Is there any queue out there like BlockingCollection that keeps as much in memory as possible, isn't durable, pages overflow to disk?

1 Answers

I ended up using BlockingCollection<NewItem>() where NewItem has Size, Page(), and GetBytes() members. Keeping the complexity low. For now am paging to disk tempfiles. Would love to find a binary manager which could page smarter.

Related