Results 1 to 7 of 7
  1. #1
    Join Date
    Feb 2005
    Posts
    48

    Red face Unanswered: Sybase Limitation to 2GB using bcp

    hello all,

    i am using bcp on a table , and this table has around 47Million entries , but when the bcp out reaches around 25Million , it failed, i checked the file system , i still have a large free space and i noticed that the file .out is 2GB.

    is there any limitations on the bcp to 2GB?
    and how can i bcp out all my table , in one file ? or should i use some options to let it work with multiple files ??

    Thank you for your help

  2. #2
    Join Date
    Feb 2007
    Location
    India
    Posts
    56

    Hi,

    You can use bcp with F and L options like

    1)bcp <dbname>..<tablename> out <filename> -F<starting_rownumber1>
    -L<ending_rownumber1> and the remaining options.
    2)bcp <dbname>..<tablename> out <filename> -F<last_cmd_lastrownumber+1>
    -L<ending_rownumber1> and the remaining options.

    you take <filename>1.out
    and <filename>2.out
    like this way.
    write a shell script

    bcp in the data using the sequence file names.
    but one more thing
    while bcp in to the data use dump tran on database between sequence.

    like
    bcp <dbname>..<tablename> in <filename>1.out remaining options
    dump tran ________________________
    bcp <dbname>..<tablename> in <filename>2.out remaining options
    dump tran ________________________
    follows

  3. #3
    Join Date
    Aug 2004
    Posts
    38
    You could see if you can get your hands on a later version of open client. Large file support was built into the later versions of open client v12.5 (for most platforms anyway), as long as your filesystem supports it.

  4. #4
    Join Date
    Jan 2003
    Location
    Geneva, Switzerland
    Posts
    353
    Check to make sure that the unix account that you use for the bcp out doesn't have a ulimit setting that limits the size of the files that can be created.

    Michael

  5. #5
    Join Date
    Feb 2005
    Posts
    48

    Thumbs up thank you , it worked with version 12.5.1

    Quote Originally Posted by KevR
    You could see if you can get your hands on a later version of open client. Large file support was built into the later versions of open client v12.5 (for most platforms anyway), as long as your filesystem supports it.
    it worked with version 12.5.1.
    thank you

  6. #6
    Join Date
    Mar 2007
    Posts
    25
    Hi,

    hope this link helps..

    http://www.sybase.com/detail?id=1011375#BABDFCAF

    Regards,
    Poornima.

  7. #7
    Join Date
    Apr 2007
    Posts
    8
    for improved bcp performance configure the following parameters

    increase default network packet size, max network packet size
    increase buffer wash area
    increase housekeeper free write percent
    increase number of pre-allocated extents

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •