DuckDB Not saving huge database

Viewed 159

We are trying to embed duckdb in our project but DuckDB doesn't seem to be able to save database after closing connection.

Informations:
Database size: 16Go
Amount of tables: 3

I searched for information about data not persisting and found nothing about whole database not persisting.

We are using the Python API, here is the setup:

%config SqlMagic.autopandas = True
%config SqlMagic.feedback = False
%config SqlMagic.displaycon = False

%sql duckdb:///./database.db

So everything works fine until we close the connection (or restart the environment). We tried to investigate using the DuckDB CLI, but same result.

So if anyone have any idea why that would happen that'd be great, this problem has nothing to do with SQL, it is purely either a hardware or a software (duckdb) problem. If nobody has an answer I'll open a ticket on their repo.

Python version: 3.10.2 64-bit on Windows

1 Answers

This is probably related to this bug, which has been fixed in the 0.5.0 version. You can install it with pip install duckdb==0.5.0

Related