wk - Daria-Maltseva/mixedmethods GitHub Wiki
Keywords analysis
Reduced network WK
WK
==============================================================================
Info on 2-Mode Network 1. C:\Mail.Ru Cloud\ANR HSE\ANR Projects\Mixed methods\Data\2019_FINAL DATASET_copy\WK.net [2-Mode] (563888)
==============================================================================
Number of vertices (n): 563888
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Total number of lines 405998 0
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 30826 0
----------------------------------------------------------
2-Mode Network: Rows=547407, Cols=16481
Density [2-Mode] = 0.00004500
Average Degree = 1.43999518
Simplification (multiple line - single line)
==============================================================================
Info on 2-Mode Network 2. Simplification (Single Line) of N1 (563888)
==============================================================================
Number of vertices (n): 563888
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Total number of lines 375172 0
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
2-Mode Network: Rows=547407, Cols=16481
Density [2-Mode] = 0.00004158
Average Degree = 1.33066141
DC partition - as 1st
Constant partition [1] of size 16481 - as 2nd
Fuse partitions
Operations -- Network + Partition -- Extract subnetwrk 1-*
==============================================================================
Extracting Subnetwork according to Partition
==============================================================================
Time spent: 0:00:00
==============================================================================
Info on 2-Mode Network 3. Extracting N2 according to C3 [1-*] (34650)
==============================================================================
Number of vertices (n): 34650
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Total number of lines 375172 0
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
2-Mode Network: Rows=18169, Cols=16481
Density [2-Mode] = 0.00125290
Average Degree = 21.65494949
2-mode network - Partition into 2 modes
Binarize partition
==============================================================================
6. Binarized C5 [1] (34650)
==============================================================================
Dimension: 34650
The lowest value: 0
The highest value: 1
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
0 16481 47.5642 16481 47.5642 disclosure
1 18169 52.4358 34650 100.0000 HILL_M(2018)34:71
----------------------------------------------------------------
Sum 34650 100.0000
Input degree partition
Max of 2 partitions
Extract subnetwork
---> we did not need to do this, as the N of Keywords is the same (they exist only for hits)
Saved as WKr
Indegree -- most used keywords
Based on Simplified network
==============================================================================
1. Input Degree of N2 (563888)
==============================================================================
Dimension: 563888
The lowest value: 0.0000
The highest value: 8367.0000
Highest values:
Rank Vertex Value Id
--------------------------------------------------------
1 547444 8367.0000 method
2 547441 8251.0000 mix
3 547420 5355.0000 health
4 547528 4592.0000 study
5 547428 4447.0000 care
6 547418 3743.0000 research
7 547531 2756.0000 education
8 547539 2190.0000 student
9 547454 2079.0000 intervention
10 547735 2054.0000 use
11 547574 2012.0000 patient
12 547424 1957.0000 social
13 547662 1950.0000 management
14 547439 1881.0000 qualitative
15 547413 1873.0000 service
16 547544 1835.0000 experience
17 547499 1814.0000 quality
18 547540 1783.0000 child
19 547522 1740.0000 community
20 547520 1639.0000 practice
21 547742 1602.0000 trial
22 547737 1572.0000 program
23 547605 1569.0000 life
24 547578 1561.0000 base
25 547525 1550.0000 analysis
26 547734 1546.0000 impact
27 547527 1487.0000 model
28 547595 1484.0000 perception
29 547690 1450.0000 development
30 547489 1431.0000 evaluation
31 547602 1377.0000 behavior
32 547517 1331.0000 self
33 547849 1315.0000 school
34 547722 1288.0000 approach
35 547487 1280.0000 risk
36 547551 1273.0000 perspective
37 547771 1269.0000 outcome
38 547422 1261.0000 woman
39 547608 1222.0000 people
40 547416 1209.0000 support
41 547826 1185.0000 control
42 547526 1168.0000 learn
43 547472 1166.0000 knowledge
44 547841 1152.0000 design
45 547558 1143.0000 adult
46 547947 1104.0000 family
47 547470 1104.0000 mental
48 547566 1025.0000 attitude
49 548032 993.0000 clinical
50 548036 980.0000 teacher
--------------------------------------------------------
Sum (all values): 375172.0000
Indegree distribution in R
setwd("C:/Mail.Ru Cloud/ANR HSE/ANR Projects/Mixed methods/Analysis/Keywords")
number<-read.table(file="WKr_Indegree.vec", sep=",", header=FALSE, skip=1)
t<-table(number)
head(t)
t
length (t)
names(t)
articles <- as.integer(names(t))
typeof(articles)
length(articles)
x <- articles[2:450]
y <- as.vector(t[2:450])
### xt <- c(1,5,10,50,100,500, 1000, 2000, 2500)
plot (x,y,log="xy",pch=16, xlab="N of works", ylab="N of keywords", main="N of works per keyword")
axis(side=1,at=xt, labels=xt)
Saved plot in the folder
Partition by Indegree
==============================================================================
14. Extracting from C9 vertices determined by C13 [1-*] (16481)
==============================================================================
Dimension: 16481
The lowest value: 1
The highest value: 8367
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
1 7695 46.6901 7695 46.6901 196
2 2069 12.5538 9764 59.2440 226
3 1112 6.7472 10876 65.9911 67
4 703 4.2655 11579 70.2567 146
5 495 3.0035 12074 73.2601 128
6 366 2.2207 12440 75.4809 200
7 312 1.8931 12752 77.3739 170
8 260 1.5776 13012 78.9515 224
9 220 1.3349 13232 80.2864 209
10 206 1.2499 13438 81.5363 390
11 153 0.9283 13591 82.4647 30
12 132 0.8009 13723 83.2656 179
13 118 0.7160 13841 83.9816 33
14 108 0.6553 13949 84.6369 45
15 92 0.5582 14041 85.1951 31
16 86 0.5218 14127 85.7169 35
17 76 0.4611 14203 86.1780 237
18 85 0.5157 14288 86.6938 301
19 65 0.3944 14353 87.0882 584
20 61 0.3701 14414 87.4583 81
21 57 0.3459 14471 87.8041 238
22 58 0.3519 14529 88.1561 692
23 43 0.2609 14572 88.4170 723
24 38 0.2306 14610 88.6475 325
25 38 0.2306 14648 88.8781 940
26 41 0.2488 14689 89.1269 230
27 41 0.2488 14730 89.3756 181
28 37 0.2245 14767 89.6001 58
29 39 0.2366 14806 89.8368 176
30 43 0.2609 14849 90.0977 223
This means that 46.7% of words are presented only once, 12.5% -- twice, etc... In general, 90% of keywords are presented only in 30 journals (= 30 times).
Networks of keywords co-occurence
Regular
WKr
Transpose, choose as 1st netw
WKr - choose as 2nd
Multiply
KK
==============================================================================
5. KK (16481)
==============================================================================
Number of vertices (n): 16481
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 1920983 0
Number of lines with value#1 897430 0
----------------------------------------------------------
Total number of lines 2818413 0
----------------------------------------------------------
Number of loops 16481 0
Number of multiple lines 0 0
----------------------------------------------------------
Density [loops allowed] = 0.01037618
Average Degree = 342.01965900
Get loops --- Remove loops ---> KKc
Arcs to Edges, Bidirected only, MIN ---> KK_clean
==============================================================================
7. Bidirected Arcs to Edges (MIN) of N6 (16481)
==============================================================================
Number of vertices (n): 16481
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 0 956644
Number of lines with value#1 0 444322
----------------------------------------------------------
Total number of lines 0 1400966
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
Density1 [loops allowed] = 0.01031550
Density2 [no loops allowed] = 0.01031613
Average Degree = 170.00982950
Islands [2, 50]: pairs of nodes + 50; [2, 100]: pairs of nodes + 100
[5,100]: 1 island of 100 nodes
Link cut:
Remove lines with values lower then (600) = 38 nodes
(411) = 76 nodes
(400) = 78 nodes
(350) = 92 nodes
Remove mix and method(34, 37)
Islands [5,100] = 99 nodes
Link cut:
(350) = 77 nodes
(300) = 95 nodes
Normalized
WKr
2-Mode Network: Rows=18169, Cols=16481
Play macro norm2.mcr (18169)
Normalized network -- Transpose 2-mode -- Choose it as 1st
Normalized - as 2nd
Multiply
KKnorm network
==============================================================================
19. KK_norm (16481)
==============================================================================
Number of vertices (n): 16481
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 0 0
Number of lines with value#1 2818413 0
----------------------------------------------------------
Total number of lines 2818413 0
----------------------------------------------------------
Number of loops 16481 0
Number of multiple lines 0 0
----------------------------------------------------------
Density [loops allowed] = 0.01037618
Average Degree = 342.01965900
Arcs to Edges --> Bidirected only - MIN
Loops - Get loops - Remove loops
21. KK_norm_clean no loops (16481)
Line cut: 1.7 = 30, 1 = 66, 0.85 = 82 nodes
Islands: [2, 200] = 1 island of 200 nodes, several -- of 3 nodes, a lot -- of 2 nodes; [5,200] = 1 island of 200 nodes.
[5,100] = 1 island of 100 (saved as KK_norm_(100 nodes))
Then tried:
mix and method = 34 and 37 -- delete the line (still 1 island of 200)
mix and method = 34 and 37 -- remove the nodes (still 1 island of 200)
[5,100]: 1 island of 100 nodes
Newman normalized
WKr
play macro2p.mcr (Newmans normalization) [18169] - number of works
- Normalized network N (previous) -- Transposed
- Newman normalized network
N'Multiply
KK_norm_newman
==============================================================================
40. KK_norm_newman (16481)
==============================================================================
Number of vertices (n): 16481
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 0 0
Number of lines with value#1 2818413 0
----------------------------------------------------------
Total number of lines 2818413 0
----------------------------------------------------------
Number of loops 16481 0
Number of multiple lines 0 0
----------------------------------------------------------
Density [loops allowed] = 0.01037618
Average Degree = 342.01965900
Remove loops
Arcs to Edges - Bidirected - SUM
KK_norm_newman_clean
==============================================================================
42. KK_norm_newman_clean (16481)
==============================================================================
Number of vertices (n): 16481
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 0 0
Number of lines with value#1 0 1400966
----------------------------------------------------------
Total number of lines 0 1400966
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
Density1 [loops allowed] = 0.01031550
Density2 [no loops allowed] = 0.01031613
Average Degree = 170.00982950
line cut:
Islands: [2,200]: 81 island, 1 of 3, 1 of 200, others of 2; [5,75]: 1 of 75
[5,100] = 1 island of 100 nodes (saved as KK_norm_newman(100 nodes))
Try to remove mix and method
==============================================================================
45. Removing vertices [34,37] from N42 (16479)
==============================================================================
Number of vertices (n): 16479
Islands: [2,200]: 2, 3, and 200; [5,100]: 1 island of 100 (saved as KK_norm_newman_w34-37(100 nodes))
!!! I guess, for now this is the best results are without mix and method in both normalized networks.
Keywords for Journals
Network construction
reduced networks nJWr x nWKr = JK
==============================================================================
Info on 2-Mode Network 74. C:\Mail.Ru Cloud\ANR HSE\ANR Projects\Mixed methods\Data\2019_FINAL DATASET_copy\WJsr.net [2-Mode] (22305)
==============================================================================
Number of vertices (n): 22305
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Total number of lines 17882 0
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
2-Mode Network: Rows=18169, Cols=4136
Density [2-Mode] = 0.00023796
Average Degree = 1.60340731
==============================================================================
Info on 2-Mode Network 3. WKr (34650)
==============================================================================
Number of vertices (n): 34650
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Total number of lines 375172 0
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
2-Mode Network: Rows=18169, Cols=16481
Density [2-Mode] = 0.00125290
Average Degree = 21.65494949
Normalized both with norm2.mcr (choose number of rows = 18169)
Transposed WJr_N' - as 1st
WKr_N - as 2nd
Multiply
JK
==============================================================================
Info on 2-Mode Network 78. JK (20617)
==============================================================================
Number of vertices (n): 20617
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 0 0
Number of lines with value#1 0 251684
----------------------------------------------------------
Total number of lines 0 251684
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
2-Mode Network: Rows=4136, Cols=16481
Density [2-Mode] = 0.00369225
Average Degree = 24.41519135
Shrinking journals
BMJ Open - 2003
BRIT MED J - 111
BMJ-BRIT MED J - 684
Cluster - Create empty cluster
Open - Add vertexes (enter the numbers)
Cluster - Make partition [dimention - number of journals 4136]
==============================================================================
80. From Cluster 1 (4136)
==============================================================================
Dimension: 4136
The lowest value: 0
The highest value: 1
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
0 4133 99.9275 4133 99.9275 1
1 3 0.0725 4136 100.0000 111
----------------------------------------------------------------
Sum 4136 100.0000
Create Constant partition (16481)
From Cluster - as 1st
Constant (16481) - as 2nd
Fuse partitions
==============================================================================
88. Fusion of C80 and C81 (20617)
==============================================================================
Dimension: 20617
The lowest value: 0
The highest value: 2
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
0 4133 20.0466 4133 20.0466 J ASSOC NURSE AIDS C
1 3 0.0146 4136 20.0611 BRIT MED J
2 16481 79.9389 20617 100.0000 disclosure
----------------------------------------------------------------
Sum 20617 100.0000
Binarize partition (1)
==============================================================================
89. Binarized C88 [1] (20617)
==============================================================================
Dimension: 20617
The lowest value: 0
The highest value: 1
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
0 20614 99.9854 20614 99.9854 J ASSOC NURSE AIDS C
1 3 0.0146 20617 100.0000 BRIT MED J
----------------------------------------------------------------
Sum 20617 100.0000
Operations - Network + Partition - Shrink network
Save as JKs
==============================================================================
Info on 2-Mode Network 80. Shrinking N78 according to C89 [1,0] (20615)
==============================================================================
Number of vertices (n): 20615
----------------------------------------------------------
Arcs Edges
----------------------------------------------------------
Number of lines with value=1 0 0
Number of lines with value#1 0 251588
----------------------------------------------------------
Total number of lines 0 251588
----------------------------------------------------------
Number of loops 0 0
Number of multiple lines 0 0
----------------------------------------------------------
2-Mode Network: Rows=4134, Cols=16481
Density [2-Mode] = 0.00369263
Average Degree = 24.40824642
Number of keywords by journals
All degree
==============================================================================
60. Extracting from V59 vertices determined by C99 [1] (4134)
==============================================================================
Dimension: 4134
The lowest value: 3.0000
The highest value: 1797.0000
Highest values:
Rank Vertex Value Id
--------------------------------------------------------
1 1 1797.0000 #BRIT MED J
2 1080 1602.0000 PLOS ONE
3 682 1581.0000 BMC PUBLIC HEALTH
4 24 1503.0000 J MIX METHOD RES
5 670 1441.0000 BMC HEALTH SERV RES
6 623 1128.0000 IMPLEMENT SCI
7 8 1084.0000 SOC SCI MED
8 18 960.0000 J ADV NURS
9 1439 917.0000 TRIALS
10 406 817.0000 J CLIN NURS
11 733 662.0000 BMC MED EDUC
12 385 647.0000 CHILD YOUTH SERV REV
13 155 636.0000 INT J NURS STUD
14 6 616.0000 QUAL HEALTH RES
15 1355 612.0000 BMC PREGNANCY CHILDB
16 898 594.0000 J MED INTERNET RES
17 288 594.0000 NURS EDUC TODAY
18 295 586.0000 INT J ENV RES PUB HE
19 32 566.0000 PATIENT EDUC COUNS
20 2046 551.0000 JMIR RES PROTOC
21 815 542.0000 BMC FAM PRACT
22 763 542.0000 DISABIL REHABIL
23 414 537.0000 EVAL PROGRAM PLANN
24 29 520.0000 MIDWIFERY
25 230 518.0000 PROCD SOC BEHV
26 9 509.0000 INT J QUAL METH
27 10 499.0000 AIDS BEHAV
28 1920 492.0000 BMC MED INFORM DECIS
29 656 487.0000 FRONT PSYCHOL
30 689 468.0000 QUAL QUANT
--------------------------------------------------------
Sum (all values): 251588.0000
Weighted alldegree
==============================================================================
62. Extracting from V61 vertices determined by C99 [1] (4134)
==============================================================================
Dimension: 4134
The lowest value: 1.0175
The highest value: 318.1206
Highest values:
Rank Vertex Value Id
--------------------------------------------------------
1 24 318.1206 J MIX METHOD RES
2 1 317.4989 #BRIT MED J
3 670 256.1339 BMC HEALTH SERV RES
4 682 218.1072 BMC PUBLIC HEALTH
5 1080 218.0348 PLOS ONE
6 623 173.1644 IMPLEMENT SCI
7 18 127.0618 J ADV NURS
8 406 101.9277 J CLIN NURS
9 8 96.9419 SOC SCI MED
10 288 92.0060 NURS EDUC TODAY
11 1439 87.4723 TRIALS
12 733 86.9443 BMC MED EDUC
13 230 83.4014 PROCD SOC BEHV
14 246 79.9542 GERONTOLOGIST
15 9 77.6766 INT J QUAL METH
16 385 75.9115 CHILD YOUTH SERV REV
17 155 62.6002 INT J NURS STUD
18 1355 61.5273 BMC PREGNANCY CHILDB
19 742 60.3352 J INTERPROF CARE
20 363 60.1768 J GEN INTERN MED
21 6 58.9148 QUAL HEALTH RES
22 847 58.1027 QUAL LIFE RES
23 898 56.9929 J MED INTERNET RES
24 414 56.0317 EVAL PROGRAM PLANN
25 29 54.5038 MIDWIFERY
26 449 52.2991 MED TEACH
27 815 51.1999 BMC FAM PRACT
28 763 50.1726 DISABIL REHABIL
29 689 50.0764 QUAL QUANT
30 3579 49.6821 EDULEARN PROC
--------------------------------------------------------
Sum (all values): 18977.1696
Keywords in selected journals
#BRIT MED J - 1
J MIX METHOD RES - 24
BRIT MED J
Partition - Create identity partition [4134] Partition - Binarize Partition
==============================================================================
92. Binarized C91 [1] (4134)
==============================================================================
Dimension: 4134
The lowest value: 0
The highest value: 1
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
0 4133 99.9758 4133 99.9758 2
1 1 0.0242 4134 100.0000 1
----------------------------------------------------------------
Sum 4134 100.0000
Constant partiton (16481)
Binarized - 1st
Constant - 2nd
Fuse patitions
==============================================================================
94. Fusion of C92 and C93 (20615)
==============================================================================
Dimension: 20615
The lowest value: 0
The highest value: 2
Frequency distribution of cluster values:
Cluster Freq Freq% CumFreq CumFreq% Representative
----------------------------------------------------------------
0 4133 20.0485 4133 20.0485 J ASSOC NURSE AIDS C
1 1 0.0049 4134 20.0534 #BRIT MED J
2 16481 79.9466 20615 100.0000 disclosure
----------------------------------------------------------------
Sum 20615 100.0000
Select JK network
Operations - Extract 1-* (this network should be used later)
2-Mode Network: Rows=1, Cols=16481
Compute WEIGHTED indegree vector Input WEIGHTED degree vector Partition Vecor+Partition - Extract SubVector (take out) 2
To get labels we need to complete this with vector:
Constant vector of 0 of set J (1) (size of cluster that we search for)
Constant vector
Extracted vector
Fuse vectors
Vector - Info - we can see the labels (most important keywords for certain island)
==============================================================================
53. Fusion of V52 and V50 (16482)
==============================================================================
Dimension: 16482
The lowest value: 0.0000
The highest value: 9.0936
Highest values:
Rank Vertex Value Id
--------------------------------------------------------
1 122 9.0936 study
2 38 9.0127 method
3 35 8.8776 mix
4 22 7.3525 care
5 14 6.4885 health
6 868 5.8097 protocol
7 48 3.7177 intervention
8 168 3.7088 patient
9 7 2.9596 service
10 336 2.8957 trial
11 83 2.7150 evaluation
12 93 2.7145 quality
13 12 2.7037 research
14 33 2.5567 qualitative
15 420 2.2863 control
16 612 2.2475 primary
17 202 2.2190 people
18 199 2.0268 life
19 256 1.8090 management
20 249 1.6371 disease
21 328 1.5629 impact
22 175 1.4850 medical
23 116 1.4658 community
24 847 1.2789 randomize
25 114 1.2766 practice
26 329 1.2694 use
27 81 1.2665 risk
28 365 1.2470 outcome
29 138 1.1588 experience
30 94 1.1466 improve
31 404 1.1429 general
32 172 1.1292 base
33 50 1.1061 framework
34 163 1.0920 hospital
35 335 1.0825 older
36 694 1.0584 implementation
37 96 1.0560 cancer
38 125 1.0407 education
39 141 1.0339 programme
40 1049 1.0261 complex
41 152 1.0108 adult
42 111 1.0093 self
43 875 0.9744 medicine
44 56 0.9581 review
45 1113 0.9573 healthcare
46 626 0.9551 clinical
47 1937 0.9513 randomise
48 331 0.9267 program
49 73 0.9208 barrier
50 196 0.9116 behavior
--------------------------------------------------------
Sum (all values): 317.4989
J MIXED METHOD RES
==============================================================================
57. Fusion of V56 and V55 (16482)
==============================================================================
Dimension: 16482
The lowest value: 0.0000
The highest value: 26.1268
Highest values:
Rank Vertex Value Id
--------------------------------------------------------
1 35 26.1268 mix
2 38 25.7109 method
3 12 16.7288 research
4 33 4.3570 qualitative
5 122 3.6796 study
6 1774 3.0256 paradigm
7 14 2.8627 health
8 18 2.8024 social
9 119 2.6315 analysis
10 435 2.3995 design
11 965 2.3764 quantitative
12 316 2.2436 approach
13 115 2.2134 datum
14 554 2.1487 methodology
15 329 2.0694 use
16 3131 2.0116 triangulation
17 284 1.7424 development
18 559 1.5145 integration
19 125 1.4855 education
20 280 1.3680 science
21 377 1.3615 theory
22 186 1.3438 new
23 116 1.2998 community
24 2798 1.2993 pragmatism
25 83 1.2569 evaluation
26 114 1.2062 practice
27 133 1.1931 student
28 145 1.1611 perspective
29 87 1.1580 strategy
30 802 1.1573 methodological
31 22 1.1275 care
32 7 1.1206 service
33 355 1.1150 validation
34 66 1.0687 knowledge
35 121 1.0591 model
36 194 1.0416 group
37 441 1.0356 integrate
38 1162 1.0160 validity
39 48 1.0159 intervention
40 1322 1.0055 future
41 196 0.9938 behavior
42 13 0.9569 state
43 471 0.9562 case
44 410 0.9430 field
45 50 0.9003 framework
46 221 0.8877 inquiry
47 331 0.8811 program
48 71 0.8107 issue
49 443 0.8027 school
50 111 0.7689 self
--------------------------------------------------------
Sum (all values): 318.1206