A A A
Manual Event (Session ID,DateTime,Event) = rkjkuen27mlvp3pvsmnf1hvp0g 20241123022141 /communities/research-design-2/

Research design

Share:
Whtasapp
Topic Discussions

Hello! I’m Dr. MEL. Nice to meet you! I’m absolutely excited that we are going to start this beautiful learning journey together and I’m sure you will find it fruitful and fulfilling. Feel free to share your thoughts here!

Recent Activity Discussions

Got questions? Simply post them and let’s discuss! 

Discussion thread: General
Toby.wong
30 December 2019
Research design

I would like to know more about research design. Any suggestions?

Reply
Like
Share
Whtasapp
Michael Lo
30 December 2019

Baseline A Treatment B Baseline A
O-O-O-O-O-X-X-X-X-X-O-O-O-O-O-O

Replies
Like
Share
Whtasapp
Gladys.Kwong
30 December 2019

Nice. Can you also elaborate in notation?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

This design needs multiple observations of a single individual. The target behavior of a single individual is established over time and is referred to as a baseline behavior. The baseline behavior is assessed, the treatment provided and then the treatment is withdrawn.

Replies
Like
Share
Whtasapp
Gladys.Kwong
30 December 2019

Great.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

I am happy to share with you! The last but not least is Single-Subject Designs. Let take A-B-A Single-Subject Design as an example.

Replies
Like
Share
Whtasapp
Gladys.Kwong
30 December 2019

Thanks a lot.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Sure. This involves random assignment of participants to 4 groups. It’s a special case of a 2X2 factorial design. Pre-tests and treatments are varied for the four groups. All groups receive a post-test.
Group A R------O------X------O
Group B R------O--------------O
Group C R --------------X-----O
Groupd D R---------------------O

Replies
Like
Share
Whtasapp
Gladys.Kwong
30 December 2019

I see. Can you elaborate more about it?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

No. We still have Solomon Four-Group Design.

Replies
Like
Share
Whtasapp
Gladys.Kwong
30 December 2019

That’s all for different kinds of True Experimental Designs?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes you are right.
Group A R------X------O
Group B R--------------O

This is the case.

Replies
Like
Share
Whtasapp
Gladys.Kwong
30 December 2019

I heard about it and it’s popular. This design controls for any confounding effects of a pre-test. The participants are assigned to groups randomly. The treatment is only given to experimental group. We measure both groups in post-test.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

You are welcome! The second one is Post-Test-Only Control-Group Design.

Replies
Like
Share
Whtasapp
Sunny Lee
30 December 2019

Thank you very much for your explanation.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes absolutely!

Replies
Like
Share
Whtasapp
Sunny Lee
30 December 2019

Let me try to illustrate by notations. Is it…
Group A R------O------X------O
Group B R------O---------------O

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

This design needs random assignment of participants to 2 groups. Both groups are administered both a pre-test and post-test but the treatment is for experimental Group A.

Replies
Like
Share
Whtasapp
Sunny Lee
30 December 2019

What does it mean?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

The first one I want to talk about is Pre-Test-Post-Test Control-Group Design.

Replies
Like
Share
Whtasapp
Sunny Lee
30 December 2019

Thanks for your reply!

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes, apart from pre-experimental and Quasi-experimental designs, there are True Experimental and Single-Subject Designs.

Replies
Like
Share
Whtasapp
Sunny Lee
30 December 2019

Are there any other types of research designs?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Sure. Please see below
Group A O--O--O—O--X--O--O--O—O
------------------------------------------------
Group B O--O--O--O--O--O--O--O--O

Replies
Like
Share
Whtasapp
Iris Man
30 December 2019

Can you express more clearly by using notations?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Its modification in which two groups of participants, not randomly assigned, are observed over time. A treatment is administered to only one of the groups (i.e., Group A).

Replies
Like
Share
Whtasapp
Iris Man
30 December 2019

What’s it?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes, the last but not least is Control-Group Interrupted Time-Series Design.

Replies
Like
Share
Whtasapp
Iris Man
30 December 2019

I see. Thank you so much! Any others?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes. It can be expressed as:
Group A O—O—O—O—X—O—O—O—O

Replies
Like
Share
Whtasapp
Iris Man
30 December 2019

I remember that we record measures for a single group both before and after a treatment.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes it is.

Replies
Like
Share
Whtasapp
Iris Man
30 December 2019

Is Single-Group Interrupted Time-Series Design also a kind of Quasi-Experimental Design?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes. You are right.

Replies
Like
Share
Whtasapp
EmilyChiu121
30 December 2019

Yes…Is it
Group A O------X------O
-----------------------------
Group B O---------------O

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

It’s a popular approach to quasi-experiments. Experimental group (A) and control group (B) are selected without random assignment. Both of them take a pre- and post-test and only the experimental group receives the treatment.

Replies
Like
Share
Whtasapp
EmilyChiu121
30 December 2019

Yes! I used it before.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

First, Nonequivalent (Pre-Test and Post-Test) Control-Group Design.

Replies
Like
Share
Whtasapp
EmilyChiu121
30 December 2019

I learnt several years ago but I’m not quite familiar with them.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Shall we talk about Quasi-Experimental Designs?

Replies
Like
Share
Whtasapp
EmilyChiu121
30 December 2019

Yes please.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes actually I just mentioned some of them. If you are interested, I can write more here.

Replies
Like
Share
Whtasapp
EmilyChiu121
30 December 2019

The above designs are ‘pre-experimental designs’. Are there any kinds of research designs?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

My pleasure.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Great. Thank you very much for giving lots of examples!

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

The exception is that the nonequivalent comparison group received a different treatment.
Group A X1------------O
----------------------------
Group B X2------------O

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Could you explain more?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

We use the same procedure as the Static Group Comparison I have just mentioned as above, with an exception.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Oh, what is it?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Last but not least, Alternative Treatment Post-Test-Only With Nonequivalent Groups Design.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Thank you very much…

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

It is used after implementing a treatment. Researchers choose a comparison group and provides a post-test to both the experimental and comparison group(s) after the treatment.
Group A X ------------O
----------------------------
Group B ---------------O

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

What is it for?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Next, Static Group Comparison or Post-Test-Only With Nonequivalent Groups.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Nice. Any others?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

The next one is One-Group Pre-Test-Post-Test Design which includes a pre-test measure followed by a treatment and a post-test for a single group.
Group A 01 ------X------02

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Thank you very much!

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes of course!

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

May I know more about the other types?

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

First, One-Shot Case Study. This design involves an exposure of a group to a treatment followed by a measure.
Group A X ------------O

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Sure.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

You are welcome. Now I am going to explain research designs in detail.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

I see. Thank you very much for your illustration in advance.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

You will see that there is a separation of parallel rows by a horizontal line. It indicates that comparison groups are not equal or equated by random assignment. No horizontal line between the groups displays random assignment of individuals to treatment groups.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Okay 

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

And random assignment is indicated with a symbol R.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

I see…

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

The left-to-right dimension refers to the temporal order of procedures in the experiment. It is indicated with an arrow sometimes.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Yes. Yes…

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

X’s and O’s in a given row are applied to the same specific persons. X’s and O’s in the same column or placed vertically relative to each other, are simultaneous.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Ok…

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

O is what we can observe or measure on an instrument.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Yes…

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

X indicates an exposure of a group to an experimental variable or event and we are going to measure the effects.

Replies
Like
Share
Whtasapp
Toby.wong
30 December 2019

Sure, thanks a lot.

Replies
Like
Share
Whtasapp
Michael Lo
30 December 2019

Yes, but before I list some example, let me use the notations to illustrate the designs.

Replies
Like
Share
Whtasapp
Latest Posts
More posts
How to evaluate a program focused on physicians’ attitudes about caring for people with disabilities?
How to evaluate a program focused on physicians’ attitudes about caring for people with disabilities?
Nathan Harris
1 November 2024
3Replies,0Months ago
Like
Share
Whtasapp
How to evaluate a program focused on using AI to support people with disability in the labor market?
How to evaluate a program focused on using AI to support people with disability in the labor market?
Nathan Harris
1 November 2024
3Replies,0Months ago
Like
Share
Whtasapp
How to evaluate a program focused on barriers to self-employment for people with disabilities?
How to evaluate a program focused on barriers to self-employment for people with disabilities?
Elijah Clark
1 November 2024
3Replies,0Months ago
Like
Share
Whtasapp
How to evaluate a program focused on how companies can support people with disabilities at work?
How to evaluate a program focused on how companies can support people with disabilities at work?
Elijah Clark
1 November 2024
3Replies,0Months ago
Like
Share
Whtasapp
Featured Posts
Hi, I realized that it seems the concept “outcome” is different from the term “output”. Taking the grandparent training project as an example, what is the “outcome’ referable?
Hi, I realized that it seems the concept "outcome" is different from the term "output". Taking the grandparent training project as an example, what is the “outcome’ referable?
CouldYip
26 August 2021
7Replies,39Months ago
Like
Share
Whtasapp
I have designed a large-scale survey about the life satisfaction of low-income families in Hong Kong. Is it appropriate to use the electronic survey through mobile phones?
I have designed a large-scale survey about the life satisfaction of low-income families in Hong Kong. Is it appropriate to use the electronic survey through mobile phones?
Realistic
20 August 2021
3Replies,39Months ago
Like
Share
Whtasapp
Questions about program evaluation and impact assessment (PE & IA)?
Dear MEL participants, Hello everyone! We are going to meet Prof. Aron Shlonsky this week (17&18 Oct). Do you have any problems or issues in program evaluation and impact assessment? Pleas ...
meladmin
15 October 2019
0Replies,61Months ago
Like
Share
Whtasapp
Question about the programme evaluation
Can someone recommend me a basic guide book for programme evaluation? We are an NGO in mainland China and providing services for young drug abusers in rural China. We learnt about your pro ...
Jessica
9 October 2019
4Replies,61Months ago
Like
Share
Whtasapp