gdxxrw error

GAMS
1

Hi

I had an issue reading the data from Excel into a gdx file, and would
like to know if anyone can help pinpoint it down so we will know what
to do in the future if it comes up again.

The line of code executed is:
$call gdxxrw %coalfile% log=coaldata_gdx.log trace=3
output=emma_coal_gdx.gdx @emma_coal_gdx.txt

and in the gdx log file I get the following error message:

Excel GDX interface GDX XRW 0003 2004-10-20
Input file : C:\Test_Input_File_04132009_v2.xls
Output file: C:\emma_coal_gdx.gdx
Type Symbol Dim Sheet Data RowHeader
ColHeader
Set FuelCoal 2 nd CoalQuality --:-- C7:D48
–:–
Par CoalQualityWithType 3 CoalQuality E7:L48
C7:D48 E6:L6
Par CoalRefiningData 4 CoalRefining F7:H33
C7:E33 F6:H6
Exception not caught: Not enough storage is available to complete this
operation
Total time = 9172 Ms


The excel spreadsheet was fairly large, 20Megs, but we have run on
much much larger spreadsheets before with no issues.

The Excel spreadsheet did contain “Excel Bloat”, but note that the
named ranges defined over the data were good, ie they did not contain
any empty/unnecessary cells.

So what I did was take a brand new Excel workbook and rebuilt it from
scratch using the data from the 20Meg version. I defined the ranges
exactly as they were in the bloated version. This new spreadsheet had
exactly the same data as the original bloated version, and data ranges
exactly the same as the bloated version, but it only took up 4Megs [ie
it eliminated the Excel Bloat].

Running this through solves just fine, the gdx read is successful.

So I am currently assuming that the issue was somehow related to Excel
Bloat, but I would like to know more as I dont quite understand how it
affects the gdx read given the named ranges were identical. Or was
the issue related to something else? As mentioned above I dont think
it is related to the size of the workbook as we regularly run much
much larger datasets with no problems.

Let me know if I can give you any more info.

Thanks in advance
Andy C
–~–~---------~–~----~------------~-------~–~----~
To post to this group, send email to gamsworld@googlegroups.com
To unsubscribe from this group, send email to gamsworld+unsubscribe@googlegroups.com
For more options, visit this group at http://groups.google.com/group/gamsworld?hl=en
-~----------~----~----~----~------~----~------~–~—

\

2

My admitted limited experience with Excel showed issues where a calculated field was formatted so that zeroes showed up as dashes (-). GAMS read this as a string when it was expecting a number. Since then we went away from calculations and went strictly to values for our inputs (as you mention you did). Our last step took us completely away from Excel completely because of data integrity issues and went to Access.

Dewayne

\

From: gamsworld@googlegroups.com [gamsworld@googlegroups.com] on behalf of AC [andrewfreestuff@gmail.com]
Sent: Monday, February 13, 2012 10:12 PM
To: gamsworld
Cc: support@gams.com
Subject: gdxxrw error

Hi

We have just started getting an error with our gdx read from Excel.
The file read has been working without issue, we did a data update and
now we sometimes get the following error in the gdxxrw log:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.gdx
Exception not caught: Call was rejected by callee
Total time = 2324 Ms

The gams command we use is:
$call gdxxrw ldc_inputdata.xlsx output=ldc_inputdata.gdx
@ldc_awrl_xls2gdx.txt log=ldc_inputdata.log trace=3


Other times we can run exactly the same file and get no problems at
all, for example I just reran the same file that gave the above error
and the log now gives us:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.xlsx
Type Symbol Dim Sheet Data RowHeader
ColHeader
DSet k 1 Block Info --:-- D7:D71
–:–
DSet t 1 Template Shapes --:-- C9:C8769
–:–
DSet y 1 Years --:-- C2:C12
–:–
Par BLOCK_HOURS 3 Block Info E6:E71 B6:D71
–:–
Par LOAD_SHAPES 3 Template Shapes E8:E8769 B8:D8769
–:–
Par MODEL_LIMITS 1 Model Limits D3:D6 C3:C6
–:–
Par PEAK_AND_ENERGY 3 Peak and Energy D5:E49
B5:C49 D4:E4
Total time = 3323 Ms


I have recreated the input file simply using paste-values and we still
get this strange seemingly random problem. It fails about 2 out of 3
attempts, works 1 out of 3 attempts.


Any ideas?

Thanks
AndyC

–
To post to this group, send email to gamsworld@googlegroups.com.
To unsubscribe from this group, send email to gamsworld+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/gamsworld?hl=en.


This e-mail transmission is strictly confidential. It is intended solely for the
addressee. If you are not the addressee, please delete the e-mail and notify us
by return email or by contacting our systems administrator on +44 131 243 4444
forthwith.

Moreover if you are not the addressee, you must not copy, use, act or rely on,
disclose or distribute this e-mail. Wood Mackenzie Limited accepts no
responsibility or liability for any harm to your, or any third party’s, system
or data caused by this e-mail or its attachments or any viruses or similar
contained in it.

Wood Mackenzie Limited may monitor and record e-mails and their content passing
through its network.

\

3

Andy,

Can’t help noticing the date in the GDXXRW banner: Christmas Eve 2007. Would be interested to know if this goes differently with 23.7.3 or the recent beta.

-steve

Sent on the Sprint® Now Network from my BlackBerry®

-----Original Message-----
From: AC
Sender: gamsworld@googlegroups.com
Date: Mon, 13 Feb 2012 19:12:17
To: gamsworld
Reply-To: gamsworld@googlegroups.com
Cc:
Subject: gdxxrw error

Hi

We have just started getting an error with our gdx read from Excel.
The file read has been working without issue, we did a data update and
now we sometimes get the following error in the gdxxrw log:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.gdx
Exception not caught: Call was rejected by callee
Total time = 2324 Ms

The gams command we use is:
$call gdxxrw ldc_inputdata.xlsx output=ldc_inputdata.gdx
@ldc_awrl_xls2gdx.txt log=ldc_inputdata.log trace=3


Other times we can run exactly the same file and get no problems at
all, for example I just reran the same file that gave the above error
and the log now gives us:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.xlsx
Type Symbol Dim Sheet Data RowHeader
ColHeader
DSet k 1 Block Info --:-- D7:D71
–:–
DSet t 1 Template Shapes --:-- C9:C8769
–:–
DSet y 1 Years --:-- C2:C12
–:–
Par BLOCK_HOURS 3 Block Info E6:E71 B6:D71
–:–
Par LOAD_SHAPES 3 Template Shapes E8:E8769 B8:D8769
–:–
Par MODEL_LIMITS 1 Model Limits D3:D6 C3:C6
–:–
Par PEAK_AND_ENERGY 3 Peak and Energy D5:E49
B5:C49 D4:E4
Total time = 3323 Ms


I have recreated the input file simply using paste-values and we still
get this strange seemingly random problem. It fails about 2 out of 3
attempts, works 1 out of 3 attempts.


Any ideas?

Thanks
AndyC

\

4

Hi Steve.

The latest version we have installed on that machine is 23.2, so I
tried that and still get the same problem:

GDXXRW Aug 14, 2009 23.2.1 WIN 11128.12582 VIS x86/MS
Windows
Excel version 12.0
Input file : I:\Current\AWRL\MCG\Data\Demand\ldc_inputdata.xlsx
Output file: I:\Current\AWRL\MCG\Data\Demand\ldc_inputdata.gdx
Exception not caught: Call was rejected by callee
Total time = 2746 Ms


I know its not exactly the version you suggested, but I am not sure
when I can get that version installed so thought I would let you know
what I tried.

On Feb 15, 3:04 am, sdir...@gams.com wrote:

Andy,

Can’t help noticing the date in the GDXXRW banner: Christmas Eve 2007. Would be interested to know if this goes differently with 23.7.3 or the recent beta.

-steve

Sent on the Sprint® Now Network from my BlackBerry®

-----Original Message-----
From: AC

Sender: gamsworld@googlegroups.com
Date: Mon, 13 Feb 2012 19:12:17
To: gamsworld
Reply-To: gamsworld@googlegroups.com
Cc:
Subject: gdxxrw error

Hi

We have just started getting an error with our gdx read from Excel.
The file read has been working without issue, we did a data update and
now we sometimes get the following error in the gdxxrw log:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.gdx
Exception not caught: Call was rejected by callee
Total time = 2324 Ms

The gams command we use is:
$call gdxxrw ldc_inputdata.xlsx output=ldc_inputdata.gdx
@ldc_awrl_xls2gdx.txt log=ldc_inputdata.log trace=3

Other times we can run exactly the same file and get no problems at
all, for example I just reran the same file that gave the above error
and the log now gives us:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.xlsx
Type Symbol Dim Sheet Data RowHeader
ColHeader
DSet k 1 Block Info --:-- D7:D71
–:–
DSet t 1 Template Shapes --:-- C9:C8769
–:–
DSet y 1 Years --:-- C2:C12
–:–
Par BLOCK_HOURS 3 Block Info E6:E71 B6:D71
–:–
Par LOAD_SHAPES 3 Template Shapes E8:E8769 B8:D8769
–:–
Par MODEL_LIMITS 1 Model Limits D3:D6 C3:C6
–:–
Par PEAK_AND_ENERGY 3 Peak and Energy D5:E49
B5:C49 D4:E4
Total time = 3323 Ms

I have recreated the input file simply using paste-values and we still
get this strange seemingly random problem. It fails about 2 out of 3
attempts, works 1 out of 3 attempts.

Any ideas?

Thanks
AndyC

–
To post to this group, send email to gamsworld@googlegroups.com.
To unsubscribe from this group, send email to gamsworld+unsubscribe@googlegroups.com.
For more options, visit this group athttp://groups.google.com/group/gamsworld?hl=en.

\

5

Andy,

You can download and try the latest GAMS version. The data utilities do not require a license file.
Regarding your problem, try the gdxxrw call with RWAIT=1000

–Paul

On Tue, Feb 14, 2012 at 3:49 PM, AC wrote:

Hi Steve.

The latest version we have installed on that machine is 23.2, so I
tried that and still get the same problem:

GDXXRW Aug 14, 2009 23.2.1 WIN 11128.12582 VIS x86/MS
Windows
Excel version 12.0
Input file : I:\Current\AWRL\MCG\Data\Demand\ldc_inputdata.xlsx
Output file: I:\Current\AWRL\MCG\Data\Demand\ldc_inputdata.gdx
Exception not caught: Call was rejected by callee
Total time = 2746 Ms


I know its not exactly the version you suggested, but I am not sure
when I can get that version installed so thought I would let you know
what I tried.

On Feb 15, 3:04 am, sdir...@gams.com wrote:

Andy,

Can’t help noticing the date in the GDXXRW banner: Christmas Eve 2007. Would be interested to know if this goes differently with 23.7.3 or the recent beta.

-steve

Sent on the Sprint® Now Network from my BlackBerry®

-----Original Message-----
From: AC

Sender: gamsworld@googlegroups.com
Date: Mon, 13 Feb 2012 19:12:17
To: gamsworld
Reply-To: gamsworld@googlegroups.com
Cc:
Subject: gdxxrw error

Hi

We have just started getting an error with our gdx read from Excel.
The file read has been working without issue, we did a data update and
now we sometimes get the following error in the gdxxrw log:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.gdx
Exception not caught: Call was rejected by callee
Total time = 2324 Ms

The gams command we use is:
$call gdxxrw ldc_inputdata.xlsx output=ldc_inputdata.gdx
@ldc_awrl_xls2gdx.txt log=ldc_inputdata.log trace=3

Other times we can run exactly the same file and get no problems at
all, for example I just reran the same file that gave the above error
and the log now gives us:

GDXXRW Dec 24, 2007 WIN.FR.NA 22.6 003.000.000.vis
Delphi
Excel version 12.0
Input file : ##removed_as_client_specific###\ldc_inputdata.xlsx
Output file: ##removed_as_client_specific###\ldc_inputdata.xlsx
Type Symbol Dim Sheet Data RowHeader
ColHeader
DSet k 1 Block Info --:-- D7:D71
–:–
DSet t 1 Template Shapes --:-- C9:C8769
–:–
DSet y 1 Years --:-- C2:C12
–:–
Par BLOCK_HOURS 3 Block Info E6:E71 B6:D71
–:–
Par LOAD_SHAPES 3 Template Shapes E8:E8769 B8:D8769
–:–
Par MODEL_LIMITS 1 Model Limits D3:D6 C3:C6
–:–
Par PEAK_AND_ENERGY 3 Peak and Energy D5:E49
B5:C49 D4:E4
Total time = 3323 Ms

I have recreated the input file simply using paste-values and we still
get this strange seemingly random problem. It fails about 2 out of 3
attempts, works 1 out of 3 attempts.

Any ideas?

Thanks
AndyC

–
To post to this group, send email to gamsworld@googlegroups.com.
To unsubscribe from this group, send email to gamsworld+unsubscribe@googlegroups.com.
For more options, visit this group athttp://groups.google.com/group/gamsworld?hl=en.

–
To post to this group, send email to gamsworld@googlegroups.com.
To unsubscribe from this group, send email to gamsworld+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/gamsworld?hl=en.



\

Paul van der Eijk
GAMS Development Corporation
Tel : (202) 342-0180 Fax : (202) 342-0181
Email: pvandereijk@gams.com
Web : http://www.gams.com

–
To post to this group, send email to gamsworld@googlegroups.com.
To unsubscribe from this group, send email to gamsworld+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/gamsworld?hl=en.