I have a huge tab-delimited text file that I’m trying to import. There are 145,247 rows, no header. One of the fields is very large, it is allowed to hold up to 10,000 characters. (I am not importing that particular field.)
I have tried to import the file multiple ways, and each time, TOAD acts like the import was successful, yet each time I only get a fraction of the rows. Once 12k, once 29k, once 31k, but never more than that.
I have checked the data in the file around the last row that imported, and not only does the data not match up, but there doesn’t appear to be any problem with the text file. I have converted it to a different encoding. . . (One example is that the data in the text file appears to be sorted by country code and then ascending city name, but the imported data appears to be sorted by country code and then descending order by city name.)
Is there a limit to how many rows I can import using the import wizard? Do I need to work with our DBAs to data pump this data in?
Digital Strategies, Cru | Data Sciences & Analytics