DATA COLLECTION
The students
The students who provided the data for this study were enrolled in and completed the freshman (first year) English 101 course at King Fahd University of Petroleum and Minerals (KFUPM) during the academic year 1989-90. As such, they are well over 95% homogenous in many respects. They can be categorized as native Arabic speakers who are Saudi nationals brought up and educated to secondary school leaving level in Saudi Arabia. They were admitted to the university on the basis of secondary school certificate grades and an entrance examination in English and Mathematics. Thus, they are among the most highly educated and literate and in most cases the most highly motivated students in Saudi Arabia.   With few exceptions, students are required to complete a Preparatory Year before being admitted to undergraduate courses. The Preparatory Year, which consists of courses in English, mathematics, mechanical engineering (workshop practice and technical drawing) and physical education, addresses several problems. Most importantly, the English proficiency implied by the secondary school certificate is inadequate for study at this English language medium university. Similarly, the mathematics courses consist of a reteaching of concepts covered at secondary school level so that they can then be applied in the predominantly technical and scientific undergraduate courses. Although not specified in the curricula, a significant feature of the Preparatory Year courses is the introduction of those learning skills necessary at the undergraduate level which are not a feature of Saudi secondary schools. These skills include the development of reliance on oneself rather than on the teacher, and the integration of discrete items of knowledge and their subsequent application to problem solving.

The Preparatory Year English courses conform to the university’s American-style semester credit system: there are two semesters (English 001 and 002), each of which involves 20 class hours a week for 16 weeks. The courses are based on and fairly strictly limited to the course books, which have evolved in-house over the years as a result of input from most of the university’s English teachers, all native English speakers experienced and qualified in EFL or ESL and predominantly British or American. The core of the courses is the Reading component, whose course books present two thematically related short readings each week and materials intended to exploit them for various reading skills. The other components (Writing, Listening, Grammar, Vocabulary and Oral) are, to varying degrees, related thematically and linguistically to this core. The significance of this for the present study is that all the students have been exposed fairly extensively to a common core of vocabulary items related not only to the topics in the Reading course books but also to the rhetorical modes practised in the Writing course books. This vocabulary may be identified in the written data.

Up to 20% of students enrolling in the Preparatory Year do not embark on freshman courses; a few of these drop all courses for personal (usually family) reasons, but most leave the university with failing or insufficiently high grades, or make a tactical withdrawal in anticipation of such grades. The remaining 80%, having proved, among other things, their ability and English language proficiency, enrol in English 101, a one semester course consisting of three class hours a week for 16 weeks. These students are the subject of this study. It is normal to take this course in the first (in American nomenclature fall) semester of the academic year. However, there are many students who enrol in the second (spring) semester, either because they are on the ‘fast track’, having been exempted from the first Preparatory Year English course, or because they are on the ‘slow track’, having had to repeat one of the Preparatory Year courses. Thus, the second semester includes a more divergent sample of good and poor students.

There are three major advantages in choosing these students for a study of misspellings. First, they have a relatively homogenous and definable history of EFL learning, especially in terms of vocabulary. Second, they are all taking the same course and taking the same (within each semester) or similar (between semesters) examinations, which provide standardized data. Finally, and most importantly, the students have developed the ability to produce suitable scripts. The level of handwriting proficiency allows nearly all misspellings to be identified as such and the level of language ability allows an interpretation of what words the misspellings are in fact misspellings of. Also, the frequency of misspellings is low enough to allow a fairly large sample of students to be studied without being completely overwhelmed by the total number of misspellings.

The data for the present study was provided by students in the two 101 courses in the academic year 1989-90. This data can be divided into two types: objective grades from multiple choice examinations, and scripts, with assigned grades, from writing examinations. While the objective grades offer a population-wide standardized measure of relative student achievement, the scripts and misspellings are from those 123 students from the total population who were in my classes during the year, and they constitute the core data.
 

Measures of student achievement

To an even greater extent than with the Preparatory Year English courses, the in-house produced 101 course books define the curriculum and are strictly reflected in the examinations. Although the official title of the course is ‘English Composition 1’, the two course books are entitled Academic Reading and Composition 1 and 2, and there are both composition and reading examinations. As far as reading is concerned, the first course book, which leads to the midterm examination, concentrates on reading freshman level textbooks while the second, which leads to the final examination, is preparation for reading journal articles.

Both the midterm and final objective examinations contain three sections: reading, grammar, and dictionary. The grammar and dictionary sections, which constitute under half of the questions, are similar in both examinations. The grammar questions are of two types: multiple choice answers to complete the blank in a sentence or sentences, and the choice of the incorrect underlined part of a sentence or sentences. The dictionary questions test the ability to use various features of entries in The American Heritage Dictionary, which is a course book. Students must use entries reprinted on the examination question paper to find, for example, the correct multiple entry or numbered definition for a word in a sentence, a suitable phrasal verb, idiom or synonym, and information from biographical and geographical entries. Proficiency and efficiency in reading are a sine qua non for answering questions in the grammar and dictionary sections, and success can legitimately be considered an indirect reflection of the students’ reading ability.

Whereas the grammar and dictionary sections are similar in the midterm and final examinations, the reading section in the two examinations differs. For the midterm examination, students must answer questions on the contents pages, glossary, index and a chapter reprinted in booklet format from a previously unseen freshman level textbook. These questions test reading proficiency more directly than the grammar and vocabulary sections. The skills required range from skimming and scanning to intensive reading, and word recognition is important to varying degrees in all these skills. Since the time allowed for the examination is limited, efficient word recognition is most directly rewarded in answering questions on the contents pages and index, and to a lesser extent the glossary questions, which involve some intensive reading. The questions on the chapter also require word recognition firstly in skimming for headings and key words to locate the section of the chapter where the answer may be found and secondly in scanning text as an efficientpreliminarstep to intensive reading.

The reading section of the final objective examination differs from that of the midterm examination in two significant ways. First, the questions are based on the cover, contents page and a half to one page article from a special interest magazine such as Middle East Education & Training or Korea Newsreview. Second, the students have a copy of the article for about a week before the examination to prepare as they will. Therefore, there is a much lower premium on efficient word recognition than in the midterm examination since the text is not only vastly shorter but also quite familiar to the students. However, between a quarter and a third of the questions are based on the cover and contents page, which are previously unseen, and here again, with limited time for the examination, efficient word recognition is vital.

For reasons of examination security, we are obliged to prepare a new objective examination for each session. There is little attempt made to standardize the level of difficulty between examinations beyond a general intuition about what our students have been and will be able to do. In fact, the mean raw scores for the total population in the four examinations under consideration range from 54.09% to 59.44%, a respectable, if felicitous, difference of only 4.35 percentage points. Nevertheless, the raw scores are converted to produce a spread of grades A, B, C, D, and F, which are the standard grades throughout the American educational system, grade A being the highest and grade F a failing grade. The number of students achieving these grades is in a roughly 10:20:40:20:10 proportion. Not only does this address the problem of possible different levels of difficulty between examinations but it also gives students a fighting chance to pass the course, since anything below 60% is defined as a failing grade in all undergraduate English courses.

The total number of questions in the four objective examinations ranges from 35 to 40. The proportion of questions of different types, for example skimming, intensive reading, grammar, dictionary, also varies. Therefore, the examinations may be said to reflect reading proficiency to varying degrees. The second semester saw the introduction of a new component in the course. This was based on a list of word prefixes and word roots, and their meanings, which students were given and told to learn. The examination questions for this component asked the meanings of words, such as revoke, which were presumably unknown to the students. These questions are only minimally related to reading skills, and the mean raw score of 45% suggests that finding the correct answer depends principally on luck. Exactly a quarter of the examination is devoted to questions on word prefixes and roots.

The results of the objective examinations, and particularly the grades resulting from raw score conversion, can be used as a measure of relative student proficiency in reading. In addition, they can be expected to reflect to some extent the students’ proficiency in word recognition.
 

Core data: the writing tasks

The writing component of English 101 centres on rhetorical modes such as identification, definition, classification, exemplification, process description, and comparison and contrast, most of which have already been extensively studied, practiced and examined in the Preparatory Year. However, whereas the Preparatory Year uses information in tables or illustrations as a stimulus for writing, English 101 focuses on texts, from which information must be extracted and whose words are hopefully paraphrased rather than plagiarized. The use of texts is intended as an introduction to English 102, entitled Researching and Reporting, during which students must find articles on which to base a short research report.

A composition examination is taken at the same sitting and immediately after the objective examination. As with the reading examination, the midterm and final composition examinations differ in important respects. In the midterm examination, that section of the textbook chapter for which there were intensive reading questions is the basis of answers to a composition question. On the other hand, the final composition examination is based on an article from a special interest magazine, but not on the same article used for the reading questions. The students are given three articles about a week before the examination; one of these is used for the reading questions, one for the composition, and one is not used. Which article will be used for which examination is not disclosed to the students and they must prepare all three articles as if for either of the examinations. Consequently, the text used for the midterm composition examination is unseen, apart from any time spent referring to it during the immediately preceding objective examination, whereas the text for the final composition examination has been prepared for a week.

There are two further differences between the midterm and final composition examinations: the nature of the texts and the examination questions. The textbook extract for the midterm examination is written in academic expository style, and is therefore organizationally, lexically and syntactically familiar to our students, who have studied similar texts extensively and intensively, not only throughout the Preparatory Year English courses but also during their freshman courses in, for example, physics, chemistry and calculus.

On the other hand, the articles chosen for the final examination display, to varying degrees, features of a journalistic style. This involves a non-linear organization of ideas, an eclectic range of lexis and tortuous syntax, all of which cause problems for our students. The articles are written, apparently under pressure of time and the indiscriminate hand of the sub-editor, to incorporate a variety of facts and quotations into a current news item which will entertain to at least as great an extent as it will inform. The following paragraph, from the article for the second semester final examination, exhibits various features that must cause difficulty for our students.
 

So far, the first priority has been to attract Gulf regionals and Gulf expatriates.(1) These vacationers will already be familiar with many local social customs and will respect them.(2) However, if Bahrain truly begins to initiate full tourist packages that attract other Western or European vacationers, the objectives and social implications will require extensive examination.(3) After all, Bahrain’s land mass is only 676 square miles, of which a portion is only suitable for touristic development.(4) One critical factor could be among the most important issues when considering the development of a tourist industry.(5) Bahrain has a genuinely traditional society which takes tremendous pride in its customs and mores.(6) Dr. Kaddam Ragab, a director with the Tourist and Archaeology directorate, says that: “We don’t want to develop a tourist scheme to a stage where it has a negative effect on our society”.(7)


At the level of discourse, the topic of this paragraph is signalled by “However” to contrast sentences (1) and (2) with the rest of the paragraph. However, this is obscured by vocabulary such as “Gulf regionals and Gulf expatriates”, which apparently contrasts with “other Western or European vacationers”. In addition, it is far from clear what “the objectives and social implications” are or that they are obliquely referred to in the following sentences. Also, it is not immediately apparent that sentence (6) is the “One critical factor” of sentence (5). Other problems could be caused by, for example, “only” in sentence (4), which should surely read “only a portion” rather than “only suitable”. In sentence (6), it is difficult to imagine the purpose of “genuinely” in “genuinely traditional society”; it is presumably an elegant variation of “very”. In the same sentence, one can imagine students interpreting the phrase “its customs and mores” as “its customs and many other things”, ‘mores’ being a plural form of ‘more’.

It is not only the types of text and the circumstances under which the students receive them that differ between the midterm and final examinations. The questions themselves reflect the different types of text. The midterm examination question refers explicitly to the rhetorical functions studied during the first half of the semester, and it can generally be answered satisfactorily with almost exclusive reference to information, and particularly vocabulary, set out in the textbook chapter. The first semester midterm composition examination exemplifies this most clearly:
 

In your own words, write a composition in which you define the term computer; classify computers into four basic categories, stating the basis of your classification; identify and briefly describe the most recent development in computers (see Section V), giving examples of applications.


This question closely follows the information, and the order of that information, in the textbook chapter. The second semester midterm composition examination is not so clear cut:
 

In your own words, write a composition in which you define the term production; identify the basic factors involved in production; and illustrate each of these factors by describing what must be done by an entrepreneur in Saudi Arabia who wants to establish a factory producing plastic knives and forks.


While the first two parts can be answered directly from the text, the last part involves a certain amount of imagination.

The final composition examination question calls for a much greater use of the students’ own ideas and vocabulary. However, it is usually based on the rhetorical functions studied in the second half of the semester: either comparison and contrast, or cause and effect. The first semester final composition examination is based on an article about science students at Kuwait University and the difficulties they face, one of which is the use of English as the medium of instruction:
 

Using both the relevant parts of the article and your own knowledge and experience, write a composition in which you describe both sides of the debate about the use of English as the medium of instruction at KFUPM.


The ‘relevant parts’ of the text are few and the significant points are referred to obliquely. The same is true of the second semester final composition examination:
 

Using both the relevant parts of the article and your own knowledge and experience, write a composition in which you explain why the causeway was built and how it has affected the lives of people both in Bahrain and in Saudi Arabia.
 

In fact, the article for this examination provides more relevant points than the first semester final text, but they are referred to even more obliquely.

The composition examination scripts are assigned grades in the following way. A standardization committee of three teachers selects scripts to represent each of the five grades on the basis of four explicit criteria: content, organization, language use and mechanics. In other words, four questions are asked. First, is the question answered explicitly, relevantly and sufficiently completely? Second, is the composition organized logically and explicitly both at the paragraph and the inter- and intrasentential levels? Third, is the language grammatical? Finally, does the composition follow the accepted norms of layout, punctuation, handwriting and spelling? In theory, these four criteria are supposed to have equal weight, and are supposed to produce a standard between semesters. In fact, there is a fifth, implicit criterion: each examination will produce a spread of grades which includes the highest and the lowest, and the mean will be grade C, which is ‘average’ by definition. Individual scripts are compared with the standardized scripts and graded twice, once by the student’s teacher and once by another teacher. Any difference in the grade awarded to a script by the two teachers is resolved by reference again to the standard scripts. Therefore, the grades for the composition examinations can be used as a general measure of relative student achievement in the writing tasks outlined above.

To sum up, the data for the present study consists of midterm and final objective and composition examination grades, and scripts from the composition examinations written by 123 English 101 students. This data will be analysed quantitatively, and then the misspellings will be further analysed.

NEXT

Hosted by www.Geocities.ws

1