J
JimS
OK, I'm sick of bloating my db every time I do external imports. Here's what
I do:
Remove all records from the permanent import table in the db (delete *)
Import from excel or csv to a temp table in the db.
Massage the data and transfer to the permanent import table in the db.
Delete the temp table (Drop)
Use the permanent import table to check integrity of the data, and update
permanent internal tables.
Use the permanent import table from time to time to do further integrity
checks.
This bloats the hell out of the db. In a single (multiple-entry) import
session, it can add 50% to the db, bringing it up over a gig in size. I can
then compact and repair it to as little as 400 MB.
So, I thought I'd go the temp DB strategy. What would you do, step-by-step
for this? Most of the imports are done using the transfertext and
transferspreadsheet commands. The updates, appends, integrity checks, etc,
are standard stored queries.
I do:
Remove all records from the permanent import table in the db (delete *)
Import from excel or csv to a temp table in the db.
Massage the data and transfer to the permanent import table in the db.
Delete the temp table (Drop)
Use the permanent import table to check integrity of the data, and update
permanent internal tables.
Use the permanent import table from time to time to do further integrity
checks.
This bloats the hell out of the db. In a single (multiple-entry) import
session, it can add 50% to the db, bringing it up over a gig in size. I can
then compact and repair it to as little as 400 MB.
So, I thought I'd go the temp DB strategy. What would you do, step-by-step
for this? Most of the imports are done using the transfertext and
transferspreadsheet commands. The updates, appends, integrity checks, etc,
are standard stored queries.