Author Topic: Identifying and handling response dependence  (Read 1257 times)

oysteg

  • Guest
Identifying and handling response dependence
« on: July 04, 2015, 11:40:23 AM »
Hi
How can I (post hoc) identify response dependence between pairs of items in ConQuest? Is there a way to resolve response dependence by e.g. forming subtest structures? (Please direct me to any tutorial or note I might have missed).
Best regards, Nanco

Eveline Gebhardt

  • Administrator
  • Full Member
  • *****
  • Posts: 103
    • View Profile
    • Email
Re: Identifying and handling response dependence
« Reply #1 on: July 16, 2015, 01:08:36 AM »
Hi Nanco

Yes, that is possible in ConQuest. You use the FIT procedure for this. This command is decribed in the Command REference Guide. Please let me know if you need further assistance.

Best wishes
Eveline

oysteg

  • Guest
Re: Identifying and handling response dependence
« Reply #2 on: July 23, 2015, 01:02:01 PM »
Hi
Thanks for your response. I am new to ConQuest. I took a look at the Command Reference Guide but I am still not able to 1) run an analysis to check for response dependence or 2) create a subtest structure accounting for possible response violation of local independence. I would be happy if anyone could post examples of command files. Best regards, Nanco.


Eveline Gebhardt

  • Administrator
  • Full Member
  • *****
  • Posts: 103
    • View Profile
    • Email
Re: Identifying and handling response dependence
« Reply #3 on: July 23, 2015, 11:57:46 PM »
Hi Nanco

After the estimate command you can add commends like these:

/* local dependence between item 1 and item 5 */
fit 1,5 >> pair.fit;

/* local dependence within two sets of 5 items */
fit 1-5:6-10 >> sets.fit;

First check if the weighted infit meansquere is significantly larger than 1. If it is significant, a practical criterion for local depence is a weighted infit MNSQ of 1.3.

Eveline

OG

  • Newbie
  • *
  • Posts: 8
    • View Profile
Re: Identifying and handling response dependence
« Reply #4 on: December 04, 2016, 06:08:44 PM »
Is there a command for outputting the residual correlation matrix in ConQuest (to check for dependent item pairs)? Are principal component analysis of residuals and eigenvalues available?
« Last Edit: December 05, 2016, 08:44:15 AM by OG »

Alvin Vista

  • Administrator
  • Newbie
  • *****
  • Posts: 18
    • View Profile
Re: Identifying and handling response dependence
« Reply #5 on: January 29, 2017, 10:48:46 PM »
Hi OG, sorry not in ConQuest.

peklyn98

  • Newbie
  • *
  • Posts: 1
    • View Profile
Re: Identifying and handling response dependence
« Reply #6 on: May 31, 2021, 06:36:51 AM »
Hi Nanco

After the estimate command you can add commends like these:

/* local dependence between item 1 and item 5 */
fit 1,5 >> pair.fit;

/* local dependence within two sets of 5 items */
fit 1-5:6-10 >> sets.fit;

First check if the weighted infit meansquere is significantly larger than 1. If it is significant, a practical criterion for local depence is a weighted infit MNSQ of 1.3.

Eveline

Hi,

If I run the 'fit' command without arguments (e.g., fit >> fit.fit), what exactly does the output show me? I thought that it would show me fit values for item pairs. I ran the command on a 6-item scale and got 36 fit values, which makes sense, but it does not seem to be the case that the fit value for item pair 1 and 2 is the same as for 2 and 1, which I thought would be the case. I could not find a good description of the analysis and output in the manual or command reference.

Per-Erik

dan_c

  • Administrator
  • Full Member
  • *****
  • Posts: 109
    • View Profile
    • Email
Re: Identifying and handling response dependence
« Reply #7 on: June 01, 2021, 11:35:10 PM »
Code: [Select]
fit >> fit.txt
This exports the fit for each generalised item (i.e., the default design matrix). Each row is an item, and this is the same as the fit statistics shown in the "show file".

Fit statistics for item pairs, would show you the fit of these two items, relative to the rest of items in the model. This kind of analysis is typically used to interrogate whether pairs of items belong together (e.g., to assess dimensionality or dependence). This would look like:

Code: [Select]
fit 1-2:3-4 ... >> fit.txt
(that is, the fit of the sum of items 1 and 2 in the default design matrix, relative to the rest of the items)

More complex fit analysis can be done by importing a custom design matrix:

https://conquestmanual.acer.org/s4-00.html#fit

more complex