A A A

If I would like to see if the random assignment works well, which t-test should I use?

Share:
Whtasapp
Topic Discussions

Hello! I’m Dr. MEL. Nice to meet you! I’m absolutely excited that we are going to start this beautiful learning journey together and I’m sure you will find it fruitful and fulfilling. Feel free to share your thoughts here!

Recent Activity Discussions

Got questions? Simply post them and let’s discuss! 

Discussion thread: General
May Chan
5 August 2020
If I would like to see if the random assignment works well, which t-test should I use?

If I would like to see if the random assignment works well, which t-test should I use?

Reply
Like
Share
Whtasapp
Miss Cheung
5 August 2020

good ^^

Replies
Like
Share
Whtasapp
May Chan
5 August 2020

Ok.

Replies
Like
Share
Whtasapp
Miss Cheung
5 August 2020

T-test is powerful in testing the group difference, but I don’t think the T-test can help you determine whether the random assignment is truly random. I suggest the following three ways to help you assess the randomness of the assignment. 1) Visually compare the distribution (box, histogram, etc.) of each variable in group A and group B. The more similar they are in appearance, the more likely the assignment was random. 2) Statistically compare the distributions of each variable in groups A and B using a goodness of fit test. Two common ones are Kolmogorov-Smirnov Test for continuous features and Chi-Squared Test for categorical features. 3) Build a simple model to predict which group an observation will be assigned to. If an assignment is truly random then you should not be able to easily predict which group the observation was assigned to.

Replies
Like
Share
Whtasapp
Latest Posts
More posts
How do program evaluations inform policy and decision-making processes related to social disadvantages?
How do program evaluations inform policy and decision-making processes related to social disadvantages?
Layla Cooper
10 April 2025
3Replies,0Months ago
Like
Share
Whtasapp
How can program evaluations be used to improve the design and implementation of future initiatives targeting social disadvantages?
How can program evaluations be used to improve the design and implementation of future initiatives targeting social disadvantages?
Scarlett Perez
10 April 2025
3Replies,0Months ago
Like
Share
Whtasapp
How can program evaluations contribute to the evidence base and knowledge sharing in addressing social disadvantages?
How can program evaluations contribute to the evidence base and knowledge sharing in addressing social disadvantages?
Scarlett Perez
10 April 2025
3Replies,0Months ago
Like
Share
Whtasapp
What are the ethical considerations in evaluating programs addressing social disadvantages?
What are the ethical considerations in evaluating programs addressing social disadvantages?
Zoey Adams
10 April 2025
3Replies,0Months ago
Like
Share
Whtasapp
Featured Posts
Hi, I realized that it seems the concept “outcome” is different from the term “output”. Taking the grandparent training project as an example, what is the “outcome’ referable?
Hi, I realized that it seems the concept "outcome" is different from the term "output". Taking the grandparent training project as an example, what is the “outcome’ referable?
CouldYip
26 August 2021
7Replies,44Months ago
Like
Share
Whtasapp
I have designed a large-scale survey about the life satisfaction of low-income families in Hong Kong. Is it appropriate to use the electronic survey through mobile phones?
I have designed a large-scale survey about the life satisfaction of low-income families in Hong Kong. Is it appropriate to use the electronic survey through mobile phones?
Realistic
20 August 2021
3Replies,44Months ago
Like
Share
Whtasapp
Questions about program evaluation and impact assessment (PE & IA)?
Dear MEL participants, Hello everyone! We are going to meet Prof. Aron Shlonsky this week (17&18 Oct). Do you have any problems or issues in program evaluation and impact assessment? Pleas ...
jml88min
15 October 2019
0Replies,66Months ago
Like
Share
Whtasapp
Question about the programme evaluation
Can someone recommend me a basic guide book for programme evaluation? We are an NGO in mainland China and providing services for young drug abusers in rural China. We learnt about your pro ...
Jessica
9 October 2019
4Replies,66Months ago
Like
Share
Whtasapp