Welcome to the dBforums forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions, articles and access our other FREE features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload your own photos and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact contact support.

If you prefer not to see double-underlined words and corresponding ads, place your cursor
here for ContentLink opt out.

Go Back  dBforums > Data Access, Manipulation & Batch Languages > Perl and the DBI > Table Access OR File Manipulation

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 02-19-02, 04:56
tho tho is offline
Registered User
 
Join Date: Feb 2002
Posts: 16
Table Access OR File Manipulation

Hi guys
I was wondering if you could help me.

I am currently designing Perl DBI code to extract data from tables from Sybase Database under UNIX.
There are a dozen of tables I need to extract information from.
The biggest tables are ACCOUNTS and SUBSCRIBERS.
ACCOUNT has 10 million rows and SUBSCRIBERS has 20 million rows.
SUBSCRIBERS is related to the ACCOUNTS table as every account has subscribers.

I am questioning my strategy for this design.
At the end of the extraction process, I need to end up with 1 or 2 flat files that shows rows of SUBSCRIBER data and rows of ACCOUNT data associated to those subscribers.

Which is the better option in terms of performance and reliability:

Access the sybase tables with SELECT+JOIN sql statements, order and write the results to the overall flat file file immediately ?

OR

BCP out the results into multiple files and manipulate/rearrange/order them into a single file under Unix.

I would be most grateful if you could help me out.
Cheers
T
Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On