| View previous topic :: View next topic |
| Author |
Message |
alanh102
Joined: 18 Sep 2007 Posts: 122 Location: Ft. Lauderdale, FL
|
Posted: Sun Apr 20, 2008 11:51 pm Post subject: Upgrading 6.7 Dbase to GMPE8.02 with large Mailbox no memory |
|
|
I have encountered a problem that I cannot solve at the moment and perhaps someone else has resolved this situation in the past or has some solution.
I installed GMPE8.02 with a dummy GoldMine database first (with nothing in it as the notes suggest).
I then proceeded to create a new dbalias to house the contacts and the GMbase files. Everything worked fine but the Mailbox will not copy into the SQL table (fully). The mailbox.dbf is like 93 megs and the Maillbox.dbt is at the max 2.065 Gigs. When it gets to about 80% it gives an error of being out of memory. I had even created two tables in SQL with aliases (one for the contacts and another for the GoldDIR (Gmbase files).
Exact error is:
Rehost Failed!
Error to init New Record in Mailbox
Out of Memory.
The server is a new one with 4 gigs of memory, Duel Core, 750 Gig Harddisk, Windows Server Standard edition 2003. I even increased the swap page size and SQL memory but no go.
I even tried it from another server that has 8 Gigs of memory.
Using Goldbox I was able to archive some data ( reduce it by 74,000 records), it was about 328,000 record originally (down to 251,000 it works). That managed to rehost fine and not run out of memory.
But I really need to get everything into the mailbox table. Can anyone suggest a way to import the mailbox data perhaps with a script or another method, like DTS transfer perhaps? GoldMine in its own world will not finish the job?
Any help or suggestions before I call Frontrange would be very helpful.
Thanks in advance for any advise on this one. |
|
| Back to top |
|
 |
bgannett
Joined: 14 Sep 2007 Posts: 2828 Location: USA
|
Posted: Mon Apr 21, 2008 12:20 am Post subject: |
|
|
I have run into that and it is a major problem with PE 8.02. This problem has been reported to FRS. I recommend the following general steps (you may need to get the assistance of a qualified Partner to get specific steps):
1. Uninstall PE.
2. While in dBase, take steps to reduce the size of mailbox. The first thing to do is to (after backing up mailbox.*) run this query. If you find a large amount of emails in Trash, delete them and this may help.
| Code: | select count(*), userid from mailbox where folder='X-GM-TRASH' Group By
USERID Order By USERID |
3. Run full maintenance with sort/verify (in dBase) on mailbox.
4. Get an "E" license so that you can temporarily turn your dBase version into a corporate edition.
5. Create an empty database in SQL, change its compatibility mode to SQL 2000, then host your dbase data to this database. This hosting will not run out of memory.
6. Install PE and get it to see this database.
7. Change the compatibility mode back to SQL 2005
You should be able to get the GMCE license from your Partner or directly from FRS. _________________ Bob Gannett
Affordable GoldMine Support
*** Free Monthly Newsletter ***
253-627-2244
goldsupport@harbornet.com |
|
| Back to top |
|
 |
DJ Hunt
Joined: 01 Jan 1970 Posts: 12666 Location: Fitchburg, MA USA
|
Posted: Mon Apr 21, 2008 12:33 am Post subject: |
|
|
Basically, your Mailbox.dbt has exceed the 2G limitation of dBase tables. You must reduce the size of that table before you can proceed. You might me able to do this with BR7, or GoldBox. I don't know for sure. You probably won't be able to do it in GoldMine Standard Edition. _________________ DJ Hunt
GoldMine Partner
Phone: (978)342-3333
Email: DJ@DJHunt.US
The Hacker's Guide to GoldMine Premium
http://www.dj-hunt.com/DWSite/Docs/GoldMine/Books_THG2GMPE_Buy.html
One-on-One GoldMine Technical Support ( Fee Based ) |
|
| Back to top |
|
 |
bgannett
Joined: 14 Sep 2007 Posts: 2828 Location: USA
|
Posted: Mon Apr 21, 2008 12:41 am Post subject: |
|
|
DJ - I agree with you statement. In the case of my client, I was able to reduce the size of mailbox to 1.5 GB but still ran out of memory when PE was attempting to bring the dBase data into SQL. That is why I had to revert to having CE bring the data into SQL before getting PE involved. This issue has been taken to senior technicians and developers and they are scratching their head on it. During the process of bringing dBase data into SQL, the problem was that the "SQLSERVR.EXE" process kept using more and more memory so that the system finally ran out of memory. My systems also had 4 GB RAM. _________________ Bob Gannett
Affordable GoldMine Support
*** Free Monthly Newsletter ***
253-627-2244
goldsupport@harbornet.com |
|
| Back to top |
|
 |
DJ Hunt
Joined: 01 Jan 1970 Posts: 12666 Location: Fitchburg, MA USA
|
Posted: Mon Apr 21, 2008 12:49 am Post subject: |
|
|
Have you tried limiting the SQL Memory that can be used. _________________ DJ Hunt
GoldMine Partner
Phone: (978)342-3333
Email: DJ@DJHunt.US
The Hacker's Guide to GoldMine Premium
http://www.dj-hunt.com/DWSite/Docs/GoldMine/Books_THG2GMPE_Buy.html
One-on-One GoldMine Technical Support ( Fee Based ) |
|
| Back to top |
|
 |
alanh102
Joined: 18 Sep 2007 Posts: 122 Location: Ft. Lauderdale, FL
|
Posted: Mon Apr 21, 2008 1:22 am Post subject: |
|
|
I have tried all of the above. I have used BR7 to delete all of the deleted trash folders. Then I packed with BR7 as GM will not complete due to the 2 gig limitation. I got the mail down as far down as possible. I used a dbase expression in BR7 to delete those Deleted records and packed in BR7.
I limited memory, changed swap space to give more memory. Used a server that had 8 Gigs with a minimimal install to the the GM server so I had memory on both servers available. Only by using Goldbox archive e-mail was I able to get it in PE8 but that is not acceptable.
Now it seem that I will have to rehost the Dbase to GM corp edition and then go through the hassle of this interim to get it in PE8. This is unacceptable. I can do it all, but it is a messy solution. I was hoping that perhaps I can just import data into the Mailbox table. Actually I now recall a product that will do this and I am using with another client for HEAT (to import warranty registration automatically each night from a website). I believe it is called SQL manager. I may try that to import the mailbox.dbf, but I am not sure if the memo field (mailbox.dbt) would go in. The dts transfer tool in SQL might be the way to go. I have to explore these avenues as I have other PE8 upgrades to do from Dbase and each have large e-mail boxes. I shall contact Frontrange for their big solution.
One other question. If I host the Corp to SQL2000 server, what is involved in attaching it to SQL2005? Will it recognize it as being SQL2000 database and convert it?
I have seen with my tests on PE8 that if the database is aliased to an older version of GM, it will tell you it will convert it to the PE8 format.
What a mess to just get the mail in. Snail mail was easier. |
|
| Back to top |
|
 |
alanh102
Joined: 18 Sep 2007 Posts: 122 Location: Ft. Lauderdale, FL
|
Posted: Mon Apr 21, 2008 1:29 am Post subject: |
|
|
| One difference that should be noted between Corp 6.7 and PE8 and Corp7 is that the borland engine is not used and everything is now done in the SQL database engine. Thus in 6.7 Corp, some queries and such are kept in dbase tables outside the SQL engine. Now it is fully inside. I spent much time with a big expert at frontrange on this regarding 7.x and slow e-mail blasts (a previous topic). Therefore, I guess 6.7 corp will host properly as some of the activity takes place in Dbase tables at some point not all in SQL. So it seems to make sense why the e-mail (usually the biggest table) has issues rehosting in PE8 and not in Corp 6.7. |
|
| Back to top |
|
 |
alanh102
Joined: 18 Sep 2007 Posts: 122 Location: Ft. Lauderdale, FL
|
Posted: Mon Apr 21, 2008 1:47 am Post subject: |
|
|
Answer to my own question.
I think this product that I have used in the past will do it.
http://www.sqlmanager.net/products/mssql/dataimport/download
I love this product and just doing a first verification I believe I can use this tool to import the dbase Mailbox into the SQL2000 Mailbox, using the recid as the unique key. Since the Conthist and Cal import fine they should link after I import the mailbox.
This is a must product and I forgot I had used it in a HEAT project for many things.
I will advise how that works out.
You have to think outside the Gold Box not always rely on Frontranges short comings. |
|
| Back to top |
|
 |
alanh102
Joined: 18 Sep 2007 Posts: 122 Location: Ft. Lauderdale, FL
|
Posted: Wed Apr 23, 2008 7:44 am Post subject: |
|
|
Success!
Just wanted to share the method that I used to resolve this e-mail mailbox rehosting issue. After talking to Frontrange, they gave the same solution that bgannett used. I am glad that bgannett told me how he got around this problem so I knew I had to get around this problem not using the method endorsed by Frontrange (installing Corp edition 6.7 and rehosting Dbase 6.7 to it and then upgrading to GMPE8 from it). They also suggested just creating another database and rehosting the mailbox at first only (but that did not work).
Here is what I did. I created two Aliased databases in SQL2005. One for the contact set (common) and the other for the Gmbase. I individually rehosted first the contact set, then the GMbase files (golddir) but not the Mailbox table.
I then used a program called Full Convert Enterprise to copy the Mailbox dbase file to the SQL GMBASE database table and in 20 minutes all was up and running.
Website for this software is www.spectralcore.com
The other software that I used for HEAT does not seem to import the Blob/memo fields and this one does. An alternate software solution is ESF Database Convert that I found and tested, but I only had a trial version, but I believe it would work just as well.
I would like to thank bgannett for taking the time to explain the steps he took, so that others and he will not have to go through such elaborate steps to just rehost the mailbox.
Case resolved by me. |
|
| Back to top |
|
 |
suttonae
Joined: 05 Mar 2008 Posts: 11 Location: UK
|
Posted: Fri Jan 09, 2009 1:12 pm Post subject: BR7 Syntax |
|
|
I have reached the 2gb limit on my mailbox
I have BR7
I'm attemting to export mail from before 2007 to a new file.
I've tried various expressions but don't wexport any records.
Any of you guys able to help?
maildate<='01/01/2007'
maildate<=DtoC("01/01/2007")
plus many more |
|
| Back to top |
|
 |
suttonae
Joined: 05 Mar 2008 Posts: 11 Location: UK
|
Posted: Fri Jan 09, 2009 1:12 pm Post subject: BR7 Syntax |
|
|
I have reached the 2gb limit on my mailbox
I have BR7
I'm attempting to export mail from before 2007 to a new file.
I've tried various expressions but don't wexport any records.
Any of you guys able to help?
maildate<='01/01/2007'
maildate<=DtoC("01/01/2007")
plus many mo |
|
| Back to top |
|
 |
Doug_Castell
Joined: 01 Jan 1970 Posts: 1948 Location: Los Angeles, CA
|
|
| Back to top |
|
 |
bgannett
Joined: 14 Sep 2007 Posts: 2828 Location: USA
|
Posted: Fri Jan 09, 2009 8:37 pm Post subject: |
|
|
Some other tricks that may help you reduce the size of your mailbox. (1) run a SQL Query to see if there is any trash (deleted emails) in mailbox. If so, delete it. You may want to check for emails that are not linked to contacts. For many people, if the email was not important enough to link, then it may not be important enough to keep. _________________ Bob Gannett
Affordable GoldMine Support
*** Free Monthly Newsletter ***
253-627-2244
goldsupport@harbornet.com |
|
| Back to top |
|
 |
Doug_Castell
Joined: 01 Jan 1970 Posts: 1948 Location: Los Angeles, CA
|
|
| Back to top |
|
 |
|