spmat import txt files

[Thomas Chuff]

Hi every body,

I would like to import a distance matrix in stata which is already constructed. So, I try to use spmat command;

My matrix is in a csv (and txt) files with value which are separated by space as recommended in the help file.
I'm using the following command:

spmat import nameofmymatrix using nameofmyfiles.txt/csv, replace

However, I have the following error message: Error in line 1 of file dfa.txt: Invalid bands

I do not understand the problem...

Thank you very much for your help,

Best regards,

Thomas

[Emad Shehata]

* you must have at least 20 observations in the spatial weight matrix
* and the contents of spmatrix must be as follow:
* first row must have only number of observations (here =20)
* number of observations in first row must be in top left cell
* first coulm time variable (1,2,...,20), starting from second observation

20
1 0 1 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2 1 0 1 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0
3 0 1 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0
4 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
5 1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0
6 1 1 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0
7 0 1 1 0 0 1 0 1 1 0 0 0 0 0 0 0 0 1 0 0
8 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0
9 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 1
10 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 1 1 0
11 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 0 1 0 0 0
12 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 1 0 0 0
13 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 1 1 0 0 0
14 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 1 0 0 0 0
15 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 0
16 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 1 0 0 0
17 0 0 0 0 0 0 0 0 0 1 1 1 1 0 0 1 0 1 1 0
18 0 0 0 0 0 0 1 1 1 1 0 0 0 0 0 0 1 0 1 1
19 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 1 0 1
20 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 1 0

* let spmat txt file will be the name (spmat.txt)
* then run the following commands:
clear all
insheet using "spmat.txt", delimiter(" ")
list, table clean noheader
save SPWMat.dta, replace
outsheet using SPWMat.txt, delimiter(" ") nonames nolabel replace
drop in 1
spmat import SPWMat using SPWMat.txt, replace normalize(row)
spmat export SPWMat using SPWMat.txt, replace
spmat save SPWMat using SPWMat.spmat, replace
* assume you have (y, x) variables, you can run the following spreg regression:

input y x
18 44
32 33
38 37
25 75
15 80
30 26
50 23
26 28
48 18
34 96
36 41
20 47
19 40
18 42
27 42
16 62
20 81
30 52
33 30
41 20
gen ID=_n
spreg ml y x , id(ID) dlmat(SPWMat) elmat(SPWMat) nolog
******************
. spreg ml y x , id(ID) dlmat(SPWMat) elmat(SPWMat) nolog
Spatial autoregressive model Number of obs = 20
(Maximum likelihood estimates) Wald chi2(1) = 6.35082
Prob > chi2 = 0.0117
------------------------------------------------------------------------------
y | Coef. Std. Err. z P>|z| [95% Conf. Interval]
-------------+----------------------------------------------------------------
y |
x | -.1908511 .075732 -2.52 0.012 -.3392831 -.042419
_cons | 26.51156 10.74083 2.47 0.014 5.459915 47.5632
-------------+----------------------------------------------------------------
lambda |
_cons | .3657362 .3480883 1.05 0.293 -.3165044 1.047977
-------------+----------------------------------------------------------------
rho |
_cons | .3023966 .4110812 0.74 0.462 -.5033076 1.108101
-------------+----------------------------------------------------------------
sigma2 |
_cons | 50.51049 16.23217 3.11 0.002 18.69602 82.32497
------------------------------------------------------------------------------

I hope that example will help
sincerely

[Emad Shehata]

see Attached File

[Emad Shehata]

* you must have at least 20 observations in the spatial weight matrix
* and the contents of spmatrix must be as follow:
* first row must have only number of observations (here =20)
* number of observations in first row must be in top left cell
* first coulm time variable (1,2,...,20), starting from second observation

   20
 1 0 1 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 2 1 0 1 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0
 3 0 1 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0
 4 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 5 1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 6 1 1 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0
 7 0 1 1 0 0 1 0 1 1 0 0 0 0 0 0 0 0 1 0 0
 8 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0
 9 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 1
 10 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 1 1 0
 11 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 0 1 0 0 0
 12 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 1 0 0 0
 13 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 1 1 0 0 0
 14 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 1 0 0 0 0
 15 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 0
 16 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 1 0 0 0
 17 0 0 0 0 0 0 0 0 0 1 1 1 1 0 0 1 0 1 1 0
 18 0 0 0 0 0 0 1 1 1 1 0 0 0 0 0 0 1 0 1 1
 19 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 1 0 1
 20 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 1 0

* let spmat txt file will be the name (spmat.txt)
* then run the following commands:
clear all
insheet using "spmat.txt", delimiter(" ")
list, table clean noheader
save SPWMat.dta, replace
outsheet using SPWMat.txt, delimiter(" ") nonames nolabel replace
drop in 1
spmat import SPWMat using SPWMat.txt, replace normalize(row)
spmat export SPWMat using SPWMat.txt, replace
spmat save SPWMat using SPWMat.spmat, replace
* assume you have (y, x) variables, you can run the following spreg regression:
input y x
18 44
32 33
38 37
25 75
15 80
30 26
50 23
26 28
48 18
34 96
36 41
20 47
19 40
18 42
27 42
16 62
20 81
30 52
33 30
41 20

gen ID=_n
spreg ml y x , id(ID) dlmat(SPWMat) elmat(SPWMat) nolog


. spreg ml y x , id(ID) dlmat(SPWMat) elmat(SPWMat) nolog

 Spatial autoregressive model Number of obs = 20
 (Maximum likelihood estimates) Wald chi2(1) = 6.35082
 Prob > chi2 = 0.0117
 ------------------------------------------------------------------------------
 y | Coef. Std. Err. z P>|z| [95% Conf. Interval]
 -------------+----------------------------------------------------------------
 y |
 x | -.1908511 .075732 -2.52 0.012 -.3392831 -.042419
 _cons | 26.51156 10.74083 2.47 0.014 5.459915 47.5632
 -------------+----------------------------------------------------------------
 lambda |
 _cons | .3657362 .3480883 1.05 0.293 -.3165044 1.047977
 -------------+----------------------------------------------------------------
 rho |
 _cons | .3023966 .4110812 0.74 0.462 -.5033076 1.108101
 -------------+----------------------------------------------------------------
 sigma2 |
 _cons | 50.51049 16.23217 3.11 0.002 18.69602 82.32497
 ------------------------------------------------------------------------------

see attachments file
I hope that example will help
sincerely

[Thomas Chuff]

Hi,

I do not why but I did not receive a notification for your answer.
Yes, the example help me a lot. But how to deal with a distance matrix? I import my matrix like that or have I inverted it before?

Should I import:

5
1 0 d12 d13 d14 d15
2 d12 0 d23 d24 d25
3 d13 d23 0 d34 d35
4 d14 d24 d34 0 d45
5 d15 d25 d35 d45 0

or:

5
1 0 1/d12 1/d13 1/d14 1/d15
2 1/d12 0 1/d23 1/d24 1/d25
3 1/d13 1/d23 0 1/d34 1/d35
4 1/d14 1/d24 1/d34 0 1/d45
5 1/d15 1/d25 1/d35 1/d45 0

Thank you very much,

Best regards,

Thomas

[Thomas Chuff]

Hi again,

My question is unclear. If I use for spatial panel data,

spregrext y x, model(sar) wmfile(W) nc(5) stand inv

What is the purpose of the options stand inv?
If I import a standardized weight matrix of the form of

5
1 0 1/d12 1/d13 1/d14 1/d15 = 1
2 1/d12 0 1/d23 1/d24 1/d25 = 1
3 1/d13 1/d23 0 1/d34 1/d35 = 1
4 1/d14 1/d24 1/d34 0 1/d45 = 1
5 1/d15 1/d25 1/d35 1/d45 0 = 1

Have I to use the option to say that my matrix is already standardized and inverted?
Or the following command is enough:

spregrext y x, model(sar) wmfile(W) nc(5)

Thank you very much again,

Best,

Thomas

[Carlos Olarte]

Hi M. Shehata
I am trying to do the same thing than Thomas and I followed all your advises. Actually, I am trying to import a commuting time matrix (231x231) done in Qgis to use it instead a contiguity matrix in order to make the spatial analysis not based on distances but on time. However, when I arrive to the step "spmat import SPWMat using SPWMat.txt, replace normalize(row)" I have as error message: "Error in line 1 of file D:\Olarte\Documents\Pour_OrbiGis\distanceW_e2.csv" . I thought it was because of the type of the variables but it seems it is not the cause. Can you please help me?
I am trying for two days to make this but I couldn't find the solution so if you can help me I will deeply appreciate of that.
All best,
Carlos O.

[Carlos Olarte]

BTW if Thomas or anybody may also help me I will really appreciate.
Thank to all!

[Sean O'Connor]

Hi all,

I'm having issues with my own matrix in STATA. I wish to import a binary matrix I created to use in a panel estimation (xsmle command).

27  
1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 0
2 0 0 0 0 0 0 1 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0 0 0 1
4 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0
5 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0 1 1 0 0 1 0 0 0 0 1 0 1 0 0 0 0 0 0
7 0 1 1 1 0 0 0 0 0 1 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1
8 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 1 0 0
9 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0
10 0 0 0 0 0 1 1 0 0 0 0 0 0 1 0 0 0 0 0 1 1 0 0 1 0 0 1
11 0 0 0 0 0 1 0 0 0 0 0 0 0 1 1 1 0 0 1 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0
13 0 0 1 0 1 0 0 0 0 0 0 1 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0
14 0 1 0 0 0 1 1 0 0 1 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0
15 0 1 0 0 0 0 0 0 0 0 1 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 0 1 0 0 0 0 0 0 1 0
17 0 0 1 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 1
19 0 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1 1 0 0 0 1 0
20 1 0 0 0 1 0 0 0 0 1 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 1
21 0 0 0 0 0 1 0 1 0 1 0 0 0 0 0 0 0 0 1 0 0 1 0 1 1 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 1 0 1 1 0
23 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 1 0
24 1 0 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0
25 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 1 1 0 0 0 0
27 0 0 1 0 0 0 1 0 0 1 0 0 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0

The above is from a txt file. I'm looking to utilise spmat import, which I'm told

By default, spmat import imports data from a space-delimited text file in which the first line contains the number of columns of the spatial-weighting matrix and, if applicable, the lower and upper band, followed by the matrix
stored row-by-row with unique place identifiers recorded in the first column.

However, when I run the command the following error occurs.

spmat import regionalweight using chance.txt
Error in line 1 of file chance.txt

From looking at the above file I cannot understand what the error is.

Any help welcome.

Sean

[Sean O'Connor]

Moreover, I follow the commands as detailed by Emad above with the following result.

insheet using "chance.txt", delimiter(" ")
list, table clean noheader
save chance.dta, replace
outsheet using chance.txt, delimiter(" ") nonames nolabel replace
drop in 1
spmat import SPWMat using chance.txt, replace normalize(row)
spmat export SPWMat using chance.txt, replace
spmat save SPWMat using chance.spmat, replace

27
1 0 0 0 0 .333333333333333 0 0 0 0 0 0 0 0 0 0 0 0 0 0 .333333333333333 0 0 0 .333333333333333 0 0 0
2 0 0 0 0 0 0 .333333333333333 0 0 0 0 0 0 .333333333333333 .333333333333333 0 0 0 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 .2 0 0 0 0 0 .2 0 0 0 .2 .2 0 0 0 0 0 0 0 0 .2
4 0 0 0 0 0 0 .5 0 0 0 0 0 0 0 0 0 .5 0 0 0 0 0 0 0 0 0 0
5 .333333333333333 0 0 0 0 0 0 0 0 0 0 0 .333333333333333 0 0 0 0 0 0 .333333333333333 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0 .2 .2 0 0 .2 0 0 0 0 .2 0 .2 0 0 0 0 0 0
7 0 .142857142857143 .142857142857143 .142857142857143 0 0 0 0 0 .142857142857143 0 0 0 .142857142857143 0 0 .142857142857143 0 0 0 0 0 0 0 0 0 .142857142857143
8 0 0 0 0 0 0 0 0 .25 0 0 0 0 0 0 0 0 0 0 0 .25 0 0 .25 .25 0 0
9 0 0 0 0 0 0 0 .333333333333333 0 0 0 0 0 0 0 0 0 0 0 0 0 0 .333333333333333 0 .333333333333333 0 0
10 0 0 0 0 0 .142857142857143 .142857142857143 0 0 0 0 0 0 .142857142857143 0 0 0 0 0 .142857142857143 .142857142857143 0 0 .142857142857143 0 0 .142857142857143
11 0 0 0 0 0 .2 0 0 0 0 0 0 0 .2 .2 .2 0 0 .2 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0
13 0 0 .2 0 .2 0 0 0 0 0 0 .2 0 0 0 0 0 .2 0 .2 0 0 0 0 0 0 0
14 0 .166666666666667 0 0 0 .166666666666667 .166666666666667 0 0 .166666666666667 .166666666666667 0 0 0 .166666666666667 0 0 0 0 0 0 0 0 0 0 0 0
15 0 .25 0 0 0 0 0 0 0 0 .25 0 0 .25 0 .25 0 0 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0 0 .25 0 0 0 .25 0 0 0 .25 0 0 0 0 0 0 .25 0
17 0 0 .333333333333333 .333333333333333 0 0 .333333333333333 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 .25 0 0 0 0 0 0 0 0 0 .25 0 0 0 0 0 0 .25 0 0 0 0 0 0 .25
19 0 0 0 0 0 .166666666666667 0 0 0 0 .166666666666667 0 0 0 0 .166666666666667 0 0 0 0 .166666666666667 .166666666666667 0 0 0 .166666666666667 0
20 .142857142857143 0 0 0 .142857142857143 0 0 0 0 .142857142857143 0 0 .142857142857143 0 0 0 0 .142857142857143 0 0 0 0 0 .142857142857143 0 0 .142857142857143
21 0 0 0 0 0 .142857142857143 0 .142857142857143 0 .142857142857143 0 0 0 0 0 0 0 0 .142857142857143 0 0 .142857142857143 0 .142857142857143 .142857142857143 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 .2 0 .2 0 .2 0 .2 .2 0
23 0 0 0 0 0 0 0 0 .25 0 0 0 0 0 0 0 0 0 0 0 0 .25 0 0 .25 .25 0
24 .2 0 0 0 0 0 0 .2 0 .2 0 0 0 0 0 0 0 0 0 .2 .2 0 0 0 0 0 0
25 0 0 0 0 0 0 0 .2 .2 0 0 0 0 0 0 0 0 0 0 0 .2 .2 .2 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 .25 0 0 .25 0 0 .25 .25 0 0 0 0
27 0 0 .2 0 0 0 .2 0 0 .2 0 0 0 0 0 0 0 .2 0 .2 0 0 0 0 0 0 0

[jack duan]

Hi,
I am struggling with how to create a spatial panel weight matrix,The

data structure is as follows:panel(25×2)，from2003-2004.
I managed to create a cross-sectional matrix using the following

commands:

1、use "D:\stataa\Stata12_WinX86_x64\2003.dta",clear
2、spwmatrix gecon lat lon,wn(W) wtype(bin) db(0 12) xport

(chance,txt)
then,I managed to create a spatial panel weight matrix using the

following commands:
3、clear all
insheet using "chance.txt", delimiter(" ")
list, table clean noheader
save SPWMat.dta, replace
outsheet using SPWMat.txt, delimiter(" ") nonames nolabel replace
drop in 1
spmat import SPWMat using SPWMat.txt, replace normalize(row)
spmat export SPWMat using SPWMat.txt, replace
spmat save SPWMat using SPWMat.spmat, replace
4、use "D:\stataa\Stata12_WinX86_x64\2003.dta",clear
5、spmat use SPWMat using "SPWMat.spmat
I am trying to run spatial panel weight matrix regression using stata

with this command:
spregdpd y x1 x2,nc(285) wmfile(SPWMat) run(xtabond)
but i get this error message
Cross Section Weight Matrix = 570
Time Series obs = 2
Sample Size (Number of obs) = 570
(Cross Sections x Time) must be Equal Sample Size
Spatial Cross Section Weight Matrix Dimension not correct
Check Correct Number Units, Unequal Time Series not Allowed.
So could you explains what's wrong or what i can do to remove that.

Best regards

[Solomon Geleta]

@ Emad Shehata
No idea what Error in line 1 of file SNAWMat.txt would mean?
spmat import SNAWMat using SNAWMat.txt, replace normalize(row)
Error in line 1 of file SNAWMat.txt

Help appreciated

[Solomon Geleta]

No Worries...I got it!

[Steven Archambault]

Hi Solomon, how did you get that to work? I am having the same problem! Thanks!

[Steven Archambault]

@ Emad Shehata
No idea what Error in line 1 of file SNAWMat.txt would mean?
spmat import SNAWMat using SNAWMat.txt, replace normalize(row)
Error in line 1 of file SNAWMat.txt

Help appreciated

Hi Solomon, how did you get that to work? I am having the same problem! Thanks!