Hi,
I have problem with extracting txt file.
What if my file has 3GB size? I made test with 120MB file (about 2 300 000 lines of data), while using Execute Data Mapping performance is rly bad even when I extraxt only one line per 60 lines.
Someone has any idea how to improve performance?
Define “really bad”?
I ran a test here by extracting full address blocks (7 lines of text) from a 125MB text file containing around 70K records.
The task ran in about 20 seconds, which is around 3.5K records per second.
Since the text extraction performance is pretty much linear, I would expect a 3MB file (which would be over 1.5 Million records) to take less than 10 minutes.
What kind of numbers are you getting?