Saturday, March 28, 2009

Quantitative Description & Quasitrue

****QUANT. DESC.

GOLEN

PURPOSE: To judge the frequency with which barriers interrupt the effective listening of college students.  Falling under this general aim were the more particular goals of identifying the barriers students thought were most frequent, the factors of the barriers themselves, and the way those factors differ over certain demographics.

SUBJECTS:  1200 students comprising three sections of a communications lecture at a southwest state university.  These lecture sections were then divided into 33 breakout sessions, each containing about 35 students.  The study randomly selected 10 of these sections, or 350 students.

COLLECTION:  Questionnaires were distributed to the students, comprising 279 different prompts.  They asked students to rank the frequency of listening barriers of a 5-point Likert scale.

ANALYSIS:  The original barrier factors were developed from a review of the literature and consultation with "several" professors.  Then a pilot study with 65 communication students refined the material used on the test questionnaire.  Answers to that questionnaire where then ranked and calculated for standard deviation.

FABER

PURPOSE:  "to record and understand the ways nanoscale science and technology continues to be represented in public media...to examine the concepts and the process by which nanoscale science and technology was first represented in the public media" (147).

SUBJECT: Mr. Faber is proud, and he should be, of reading 885 articles on nanotechnology, covering the period between January 1986 and December 1999.  He framed that original population by using his university's ProQuest server to ferret out articles with the keyword of "nanotechnology."  From that large pool he then excluded popular publications and repeat article printings, leaving him with final collection of 203 articles.

COLLECTION: He came up with the marvelously precise and equally arcane method of separating sentences into themes (left of the verb) and rhemes (after the verb).  He then took those elements and examined them for topics of nanotech.  That yielded 39 topics, which he then labeled representations and returned back to the 203 articles to sift those representations (this last pass is the one that is most obscure).

ANALYSIS:  With his list of representations, Faber then could easily rank them temporally and discern the frequency of their occurrence.  He categorized these frequencies in three groups: high, average, and low-occurring.

*****Quasitrue

NOTARANT

PURPOSE: The study emerges from Norton's communicator style, especially its dimensions of Openness and Dominance.  It seeks to understand what effects these different communicator styles produce between salesman and customer.

SUBJECTS: 80 undergraduate business students at Bryant college.  No real indication was given as to how these subjects were selected.

COLLECTION: Two performers staged four videos.  In each the customer remained neutral while the salesperson shifted pitch across a four-step scale (Dominant; Dominant/Open; Open/Dominant; Open).  "A small group of subjects" was then asked to match the videos to the 4 step scale.  Everyone (testers and experimenters) were in agreement.  Groups of 5-6 subjects from the sample were then asked first to self-evaluate alla Norton's communicator style.  They then viewed the tapes and filled out a 42-question Likert-scale questionnaire.

ANALYSIS:  Many of the questions had been pre-determined to relate to similar ideas.  Thus, the raters were easily able to generate six composite scores: perception of salespeople in general, the product being sold, the interaction on tape, the act of buying in general, and the actual salesperson on tape.



KRULL

PURPOSE: The overriding goal had a long reach: "to explore...patterns of thought and language that characterize growth in informative writing ability across junior- and senior-high-school years."  A little less broadly, the study looked at the capacities of students to navigate and communicate information change over grade levels by seeing how they pass on directions of a board game they have just played.

SUBJECTS: 24 5th graders, 26 seventh graders, 19 hs freshman, 27 hs juniors, and 27 college freshman were pulled from English classes at four schools from the same city in central Iowa as well as Iowa State University.  But the researcher eliminated those subjects who could not demonstrate a basic proficiency with the game (this is a little vague—plus, aren't they an important part of this range?).

COLLECTION: First, students watched a silent film showing a teacher and a student playing the game.  Three days later they watched it again.  Using a small card identifying the game pieces by name, students then had to write out the directions to the game as completely as possible.  A multiple choice quiz followed, which had been validated by administering it to college seniors unversed in the game; they didn't score much better than chance allowed.  (Yuck: why is it a quiz when kids are young and a survey when they get older?).

ANALYSIS: This was involved.  The game was broken into 10 elements, each element given a value depending on complexity, and then scored by two raters.  Extra points were given for extra clarity.  The experimenter evaluated the college student work and was checked against another rater (who didn't rate all the college submissions).  Two raters also checked for evidence of "orientating information" at the start of the instructions.  Again, two raters evaluated the mode of address the information used.  Finally the scores were adjusted for grade level, crunched for trends, and subjected to chi-square tests.

CAROLL

Ex 1

PURPOSE: To show why a minimal manual is better than the standard maxi-manual.

SUBJECTS:  19 people who "were experienced with routine office work" and had little experience with computers.  A temp agency screened them (!).

COLLECTION: Groups of two to three were plugged into a simulated office environment, some with maxi some with mini manuals, and given a task list to perform on the computer.  For help they could phone a fake hotline.

ANALYSIS:  Efficiency (key strokes), correctness and timeliness were the qualities prioritized in rating the task performance.

Ex 2

PURPOSE: Same as EX 1, this one adding the variables of "learn by the book" or "learn while doing" to the maxi and mini manuals, yielding four categories to test.

SUBJECTS:  32 people were chose by similar means as EX 1, only this time they were distributed into the four groups to control for age.

COLLECTION: Subjects were given 5 hours to preform 6 tasks.   They verbalized their actions and an observer time stamped all recordings, intervening if the subject became flummoxed or stuck for more than 20 minutes.

ANALYSIS:  Time and success (the number of sub-tasks completed) were given priority.  Observers also tried to measure attention and effort durning the process (a slippery task, it seems).  Finally errors, of course, couldn't be overlooked.

1 comment:

  1. I think you did a fantastic job with these articles. You were able to focus your attention to each research paper's description (or lack therof) of the methodology used, the research question(s), subject selection, data collection, and data analysis. Also you included several quick asides with your opinion of what the researchers did correctly or incorrectly. This is very important to include, but I think it's great that you don't lose focus of synthesizing the research methodologies of each study.

    ReplyDelete