Variable Explanation:
Independent variable (N= 1): Test_Level
Dependent variables (N= 4): Total_points_10, Total_points_5, count_3, Streak_count_10
Covariates (N=4): age, gender, score, language
1. Gender: 0 – female, 1 – male
2. Language: 0 – Spanish, 1 – Portuguese
Research Question: What was the main effect of users’ current learning level on this learning platform on the gamification activity, controlling for the effects of their demographic information such as age, gender, score, and language?
Between-Subjects Factors
N
test_level
1
23410
2
13738
3
7539
4
8116
5
2456
6
21
7
2
8
6
Descriptive Statistics
test_level
Mean
Std. Deviation
N
total_points_10
1
1260.22
1851.976
23410
2
1448.49
2024.436
13738
3
1359.30
1830.455
7539
4
1453.10
1903.161
8116
5
1311.44
1696.995
2456
6
5153.00
3746.860
21
7
4727.50
6564.072
2
8
4578.83
2994.365
6
Total
1353.06
1899.478
55288
count_3
1
219.34
427.093
23410
2
255.37
456.595
13738
3
241.21
425.781
7539
4
255.59
439.384
8116
5
222.29
389.003
2456
6
1096.14
960.388
21
7
1075.00
1511.794
2
8
783.83
794.352
6
Total
237.15
435.725
55288
total_points_5
1
26470.43
59885.302
23410
2
31177.38
64946.948
13738
3
29511.56
62270.939
7539
4
31322.98
64218.226
8116
5
27809.44
58682.160
2456
6
153305.52
137790.870
21
7
134686.00
190231.523
2
8
126757.17
96474.494
6
Total
28889.48
62240.437
55288
streak_count_10
1
329.56
1301.352
23410
2
409.67
1508.006
13738
3
397.83
1332.699
7539
4
464.90
1799.720
8116
5
442.08
1464.427
2456
6
1998.24
2494.016
21
7
406.00
557.200
2
8
3628.83
5911.882
6
Total
384.64
1450.859
55288
Multivariate Testsa
Effect
Value
F
Hypothesis df
Error df
Sig.
Partial Eta Squared
Intercept
Pillai’s Trace
.002
31.174b
4.000
55273.000
<.001
.002
Wilks' Lambda
.998
31.174b
4.000
55273.000
<.001
.002
Hotelling's Trace
.002
31.174b
4.000
55273.000
<.001
.002
Roy's Largest Root
.002
31.174b
4.000
55273.000
<.001
.002
age
Pillai's Trace
.004
59.615b
4.000
55273.000
<.001
.004
Wilks' Lambda
.996
59.615b
4.000
55273.000
<.001
.004
Hotelling's Trace
.004
59.615b
4.000
55273.000
<.001
.004
Roy's Largest Root
.004
59.615b
4.000
55273.000
<.001
.004
gender
Pillai's Trace
.001
10.220b
4.000
55273.000
<.001
.001
Wilks' Lambda
.999
10.220b
4.000
55273.000
<.001
.001
Hotelling's Trace
.001
10.220b
4.000
55273.000
<.001
.001
Roy's Largest Root
.001
10.220b
4.000
55273.000
<.001
.001
score
Pillai's Trace
.007
98.205b
4.000
55273.000
<.001
.007
Wilks' Lambda
.993
98.205b
4.000
55273.000
<.001
.007
Hotelling's Trace
.007
98.205b
4.000
55273.000
<.001
.007
Roy's Largest Root
.007
98.205b
4.000
55273.000
<.001
.007
language
Pillai's Trace
.002
22.431b
4.000
55273.000
<.001
.002
Wilks' Lambda
.998
22.431b
4.000
55273.000
<.001
.002
Hotelling's Trace
.002
22.431b
4.000
55273.000
<.001
.002
Roy's Largest Root
.002
22.431b
4.000
55273.000
<.001
.002
test_level
Pillai's Trace
.006
11.891
28.000
221104.000
<.001
.002
Wilks' Lambda
.994
11.902
28.000
199291.058
<.001
.002
Hotelling's Trace
.006
11.911
28.000
221086.000
<.001
.002
Roy's Largest Root
.004
33.237c
7.000
55276.000
<.001
.004
a. Design: Intercept + age + gender + score + language + test_level
b. Exact statistic
c. The statistic is an upper bound on F that yields a lower bound on the significance level.
Tests of Between-Subjects Effects
Source
Dependent Variable
Type III Sum of Squares
df
Mean Square
F
Sig.
Partial Eta Squared
Corrected Model
total_points_10
2082010290.885a
11
189273662.808
53.002
<.001
.010
count_3
81105437.236b
11
7373221.567
39.130
<.001
.008
total_points_5
1468875799818.094c
11
133534163619.827
34.702
<.001
.007
streak_count_10
304653399.495d
11
27695763.590
13.189
<.001
.003
Intercept
total_points_10
390461884.163
1
390461884.163
109.340
<.001
.002
count_3
13078101.308
1
13078101.308
69.407
<.001
.001
total_points_5
287817668815.504
1
287817668815.504
74.795
<.001
.001
streak_count_10
68920941.070
1
68920941.070
32.821
<.001
.001
age
total_points_10
138559428.864
1
138559428.864
38.801
<.001
.001
count_3
74057.881
1
74057.881
.393
.531
.000
total_points_5
113451976679.061
1
113451976679.061
29.483
<.001
.001
streak_count_10
703430.902
1
703430.902
.335
.563
.000
gender
total_points_10
8769524.293
1
8769524.293
2.456
.117
.000
count_3
1533353.562
1
1533353.562
8.138
.004
.000
total_points_5
12483229.199
1
12483229.199
.003
.955
.000
streak_count_10
27043958.169
1
27043958.169
12.879
<.001
.000
score
total_points_10
1119813147.344
1
1119813147.344
313.579
<.001
.006
count_3
43468332.785
1
43468332.785
230.691
<.001
.004
total_points_5
666967448726.338
1
666967448726.338
173.325
<.001
.003
streak_count_10
18262588.432
1
18262588.432
8.697
.003
.000
language
total_points_10
660389.934
1
660389.934
.185
.667
.000
count_3
1786028.443
1
1786028.443
9.479
.002
.000
total_points_5
5687788320.604
1
5687788320.604
1.478
.224
.000
streak_count_10
98972.067
1
98972.067
.047
.828
.000
test_level
total_points_10
745233925.013
7
106461989.288
29.812
<.001
.004
count_3
34638334.285
7
4948333.469
26.261
<.001
.003
total_points_5
612290775913.132
7
87470110844.733
22.731
<.001
.003
streak_count_10
147242821.913
7
21034688.845
10.017
<.001
.001
Error
total_points_10
197394414539.837
55276
3571069.081
count_3
10415490088.186
55276
188426.986
total_points_5
212705883995101.100
55276
3848069397.118
streak_count_10
116074008642.958
55276
2099898.847
Total
total_points_10
300696706571.000
55288
count_3
13606114105.000
55288
total_points_5
260318253837769.000
55288
streak_count_10
124558199993.000
55288
Corrected Total
total_points_10
199476424830.722
55287
count_3
10496595525.422
55287
total_points_5
214174759794919.200
55287
streak_count_10
116378662042.453
55287
a. R Squared = .010 (Adjusted R Squared = .010)
b. R Squared = .008 (Adjusted R Squared = .008)
c. R Squared = .007 (Adjusted R Squared = .007)
d. R Squared = .003 (Adjusted R Squared = .002)
Pairwise Comparisons
Dependent Variable
(I) test_level
(J) test_level
Mean Difference (I-J)
Std. Error
Sig.b
95% Confidence Interval for Differenceb
Lower Bound
Upper Bound
total_points_10
1
2
34.835
23.960
1.000
-40.014
109.684
3
181.032*
29.759
<.001
88.067
273.997
4
207.021*
33.313
<.001
102.956
311.087
5
343.311*
45.922
<.001
199.857
486.766
6
-4004.598*
412.635
<.001
-5293.624
-2715.572
7
-3182.368
1336.409
.483
-7357.158
992.421
8
-3174.411*
771.645
.001
-5584.942
-763.880
2
1
-34.835
23.960
1.000
-109.684
40.014
3
146.197*
27.304
<.001
60.902
231.492
4
172.187*
28.302
<.001
83.773
260.600
5
308.477*
42.534
<.001
175.604
441.349
6
-4039.433*
413.176
<.001
-5330.147
-2748.718
7
-3217.203
1336.383
.450
-7391.911
957.505
8
-3209.246*
771.695
<.001
-5619.933
-798.559
3
1
-181.032*
29.759
<.001
-273.997
-88.067
2
-146.197*
27.304
<.001
-231.492
-60.902
4
25.989
30.952
1.000
-70.702
122.681
5
162.279*
44.363
.007
23.695
300.864
6
-4185.630*
413.607
<.001
-5477.690
-2893.570
7
-3363.400
1336.466
.332
-7538.369
811.568
8
-3355.443*
771.863
<.001
-5766.657
-944.229
4
1
-207.021*
33.313
<.001
-311.087
-102.956
2
-172.187*
28.302
<.001
-260.600
-83.773
3
-25.989
30.952
1.000
-122.681
70.702
5
136.290*
43.525
.049
.324
272.256
6
-4211.619*
413.987
<.001
-5504.868
-2918.370
7
-3389.390
1336.482
.314
-7564.409
785.630
8
-3381.433*
771.945
<.001
-5792.901
-969.965
5
1
-343.311*
45.922
<.001
-486.766
-199.857
2
-308.477*
42.534
<.001
-441.349
-175.604
3
-162.279*
44.363
.007
-300.864
-23.695
4
-136.290*
43.525
.049
-272.256
-.324
6
-4347.909*
415.182
<.001
-5644.891
-3050.927
7
-3525.680
1336.858
.234
-7701.872
650.513
8
-3517.723*
772.594
<.001
-5931.218
-1104.227
6
1
4004.598*
412.635
<.001
2715.572
5293.624
2
4039.433*
413.176
<.001
2748.718
5330.147
3
4185.630*
413.607
<.001
2893.570
5477.690
4
4211.619*
413.987
<.001
2918.370
5504.868
5
4347.909*
415.182
<.001
3050.927
5644.891
7
822.229
1398.593
1.000
-3546.817
5191.275
8
830.187
874.906
1.000
-1902.920
3563.293
7
1
3182.368
1336.409
.483
-992.421
7357.158
2
3217.203
1336.383
.450
-957.505
7391.911
3
3363.400
1336.466
.332
-811.568
7538.369
4
3389.390
1336.482
.314
-785.630
7564.409
5
3525.680
1336.858
.234
-650.513
7701.872
6
-822.229
1398.593
1.000
-5191.275
3546.817
8
7.957
1542.978
1.000
-4812.130
4828.045
8
1
3174.411*
771.645
.001
763.880
5584.942
2
3209.246*
771.695
<.001
798.559
5619.933
3
3355.443*
771.863
<.001
944.229
5766.657
4
3381.433*
771.945
<.001
969.965
5792.901
5
3517.723*
772.594
<.001
1104.227
5931.218
6
-830.187
874.906
1.000
-3563.293
1902.920
7
-7.957
1542.978
1.000
-4828.045
4812.130
count_3
1
2
8.672
5.504
1.000
-8.521
25.866
3
35.128*
6.836
<.001
13.773
56.482
4
44.449*
7.652
<.001
20.545
68.353
5
76.935*
10.549
<.001
43.983
109.887
6
-898.547*
94.785
<.001
-1194.644
-602.450
7
-804.466
306.981
.246
-1763.440
154.509
8
-536.459
177.252
.069
-1090.173
17.254
2
1
-8.672
5.504
1.000
-25.866
8.521
3
26.455*
6.272
<.001
6.863
46.048
4
35.777*
6.501
<.001
15.468
56.086
5
68.263*
9.770
<.001
37.741
98.784
6
-907.219*
94.909
<.001
-1203.704
-610.735
7
-813.138
306.975
.226
-1772.093
145.818
8
-545.132
177.263
.059
-1098.881
8.618
3
1
-35.128*
6.836
<.001
-56.482
-13.773
2
-26.455*
6.272
<.001
-46.048
-6.863
4
9.321
7.110
1.000
-12.889
31.532
5
41.807*
10.190
.001
9.974
73.641
6
-933.675*
95.008
<.001
-1230.469
-636.881
7
-839.593
306.994
.175
-1798.609
119.422
8
-571.587*
177.302
.035
-1125.458
-17.717
4
1
-44.449*
7.652
<.001
-68.353
-20.545
2
-35.777*
6.501
<.001
-56.086
-15.468
3
-9.321
7.110
1.000
-31.532
12.889
5
32.486*
9.998
.032
1.254
63.718
6
-942.996*
95.095
<.001
-1240.063
-645.929
7
-848.915
306.998
.159
-1807.942
110.113
8
-580.909*
177.320
.029
-1134.837
-26.980
5
1
-76.935*
10.549
<.001
-109.887
-43.983
2
-68.263*
9.770
<.001
-98.784
-37.741
3
-41.807*
10.190
.001
-73.641
-9.974
4
-32.486*
9.998
.032
-63.718
-1.254
6
-975.482*
95.370
<.001
-1273.407
-677.558
7
-881.401
307.084
.115
-1840.697
77.896
8
-613.395*
177.469
.015
-1167.789
-59.000
6
1
898.547*
94.785
<.001
602.450
1194.644
2
907.219*
94.909
<.001
610.735
1203.704
3
933.675*
95.008
<.001
636.881
1230.469
4
942.996*
95.095
<.001
645.929
1240.063
5
975.482*
95.370
<.001
677.558
1273.407
7
94.082
321.265
1.000
-909.515
1097.678
8
362.088
200.971
1.000
-265.723
989.899
7
1
804.466
306.981
.246
-154.509
1763.440
2
813.138
306.975
.226
-145.818
1772.093
3
839.593
306.994
.175
-119.422
1798.609
4
848.915
306.998
.159
-110.113
1807.942
5
881.401
307.084
.115
-77.896
1840.697
6
-94.082
321.265
1.000
-1097.678
909.515
8
268.006
354.431
1.000
-839.197
1375.209
8
1
536.459
177.252
.069
-17.254
1090.173
2
545.132
177.263
.059
-8.618
1098.881
3
571.587*
177.302
.035
17.717
1125.458
4
580.909*
177.320
.029
26.980
1134.837
5
613.395*
177.469
.015
59.000
1167.789
6
-362.088
200.971
1.000
-989.899
265.723
7
-268.006
354.431
1.000
-1375.209
839.197
total_points_5
1
2
732.617
786.530
1.000
-1724.413
3189.647
3
3794.411*
976.887
.003
742.725
6846.096
4
4934.741*
1093.534
<.001
1518.664
8350.818
5
8326.855*
1507.444
<.001
3617.773
13035.938
6
-129629.299*
13545.303
<.001
-171943.289
-87315.310
7
-101584.203
43869.394
.576
-238627.216
35458.811
8
-97124.408*
25330.270
.004
-176253.300
-17995.516
2
1
-732.617
786.530
1.000
-3189.647
1724.413
3
3061.794*
896.296
.018
261.866
5861.722
4
4202.125*
929.064
<.001
1299.835
7104.414
5
7594.239*
1396.246
<.001
3232.526
11955.952
6
-130361.916*
13563.044
<.001
-172731.326
-87992.506
7
-102316.819
43868.536
.551
-239357.153
34723.514
8
-97857.025*
25331.912
.003
-176991.046
-18723.003
3
1
-3794.411*
976.887
.003
-6846.096
-742.725
2
-3061.794*
896.296
.018
-5861.722
-261.866
4
1140.331
1016.047
1.000
-2033.685
4314.346
5
4532.445
1456.270
.052
-16.776
9081.666
6
-133423.710*
13577.183
<.001
-175837.291
-91010.129
7
-105378.613
43871.275
.457
-242427.502
31670.276
8
-100918.818*
25337.445
.002
-180070.124
-21767.513
4
1
-4934.741*
1093.534
<.001
-8350.818
-1518.664
2
-4202.125*
929.064
<.001
-7104.414
-1299.835
3
-1140.331
1016.047
1.000
-4314.346
2033.685
5
3392.114
1428.758
.493
-1071.165
7855.393
6
-134564.041*
13589.681
<.001
-177016.662
-92111.419
7
-106518.944
43871.811
.425
-243569.508
30531.621
8
-102059.149*
25340.114
.002
-181218.792
-22899.507
5
1
-8326.855*
1507.444
<.001
-13035.938
-3617.773
2
-7594.239*
1396.246
<.001
-11955.952
-3232.526
3
-4532.445
1456.270
.052
-9081.666
16.776
4
-3392.114
1428.758
.493
-7855.393
1071.165
6
-137956.155*
13628.907
<.001
-180531.315
-95380.995
7
-109911.058
43884.136
.343
-247000.124
27178.009
8
-105451.263*
25361.417
<.001
-184677.456
-26225.071
6
1
129629.299*
13545.303
<.001
87315.310
171943.289
2
130361.916*
13563.044
<.001
87992.506
172731.326
3
133423.710*
13577.183
<.001
91010.129
175837.291
4
134564.041*
13589.681
<.001
92111.419
177016.662
5
137956.155*
13628.907
<.001
95380.995
180531.315
7
28045.097
45910.675
1.000
-115374.645
171464.839
8
32504.892
28719.944
1.000
-57212.957
122222.740
7
1
101584.203
43869.394
.576
-35458.811
238627.216
2
102316.819
43868.536
.551
-34723.514
239357.153
3
105378.613
43871.275
.457
-31670.276
242427.502
4
106518.944
43871.811
.425
-30531.621
243569.508
5
109911.058
43884.136
.343
-27178.009
247000.124
6
-28045.097
45910.675
1.000
-171464.839
115374.645
8
4459.795
50650.297
1.000
-153765.989
162685.579
8
1
97124.408*
25330.270
.004
17995.516
176253.300
2
97857.025*
25331.912
.003
18723.003
176991.046
3
100918.818*
25337.445
.002
21767.513
180070.124
4
102059.149*
25340.114
.002
22899.507
181218.792
5
105451.263*
25361.417
<.001
26225.071
184677.456
6
-32504.892
28719.944
1.000
-122222.740
57212.957
7
-4459.795
50650.297
1.000
-162685.579
153765.989
streak_count_10
1
2
-50.279
18.374
.174
-107.676
7.118
3
-29.587
22.820
1.000
-100.875
41.701
4
-81.344*
25.545
.041
-161.144
-1.543
5
-58.559
35.214
1.000
-168.564
51.446
6
-1675.547*
316.422
<.001
-2664.013
-687.081
7
-23.609
1024.801
1.000
-3224.970
3177.751
8
-3265.001*
591.722
<.001
-5113.473
-1416.529
2
1
50.279
18.374
.174
-7.118
107.676
3
20.692
20.938
1.000
-44.715
86.099
4
-31.065
21.703
1.000
-98.863
36.734
5
-8.280
32.617
1.000
-110.171
93.611
6
-1625.268*
316.836
<.001
-2615.029
-635.507
7
26.670
1024.781
1.000
-3174.629
3227.968
8
-3214.722*
591.760
<.001
-5063.313
-1366.130
3
1
29.587
22.820
1.000
-41.701
100.875
2
-20.692
20.938
1.000
-86.099
44.715
4
-51.757
23.735
.818
-125.903
22.389
5
-28.972
34.019
1.000
-135.243
77.299
6
-1645.960*
317.167
<.001
-2636.753
-655.168
7
5.977
1024.845
1.000
-3195.521
3207.475
8
-3235.414*
591.889
<.001
-5084.409
-1386.419
4
1
81.344*
25.545
.041
1.543
161.144
2
31.065
21.703
1.000
-36.734
98.863
3
51.757
23.735
.818
-22.389
125.903
5
22.785
33.376
1.000
-81.479
127.048
6
-1594.203*
317.459
<.001
-2585.908
-602.499
7
57.734
1024.857
1.000
-3143.803
3259.272
8
-3183.657*
591.952
<.001
-5032.847
-1334.467
5
1
58.559
35.214
1.000
-51.446
168.564
2
8.280
32.617
1.000
-93.611
110.171
3
28.972
34.019
1.000
-77.299
135.243
4
-22.785
33.376
1.000
-127.048
81.479
6
-1616.988*
318.375
<.001
-2611.555
-622.421
7
34.950
1025.145
1.000
-3167.487
3237.386
8
-3206.442*
592.449
<.001
-5057.187
-1355.697
6
1
1675.547*
316.422
<.001
687.081
2664.013
2
1625.268*
316.836
<.001
635.507
2615.029
3
1645.960*
317.167
<.001
655.168
2636.753
4
1594.203*
317.459
<.001
602.499
2585.908
5
1616.988*
318.375
<.001
622.421
2611.555
7
1651.938
1072.485
1.000
-1698.385
5002.261
8
-1589.454
670.905
.499
-3685.286
506.379
7
1
23.609
1024.801
1.000
-3177.751
3224.970
2
-26.670
1024.781
1.000
-3227.968
3174.629
3
-5.977
1024.845
1.000
-3207.475
3195.521
4
-57.734
1024.857
1.000
-3259.272
3143.803
5
-34.950
1025.145
1.000
-3237.386
3167.487
6
-1651.938
1072.485
1.000
-5002.261
1698.385
8
-3241.391
1183.204
.172
-6937.587
454.805
8
1
3265.001*
591.722
<.001
1416.529
5113.473
2
3214.722*
591.760
<.001
1366.130
5063.313
3
3235.414*
591.889
<.001
1386.419
5084.409
4
3183.657*
591.952
<.001
1334.467
5032.847
5
3206.442*
592.449
<.001
1355.697
5057.187
6
1589.454
670.905
.499
-506.379
3685.286
7
3241.391
1183.204
.172
-454.805
6937.587
Based on estimated marginal means
*. The mean difference is significant at the .05 level.
b. Adjustment for multiple comparisons: Bonferroni.