🌿 authenticity
✔️ Bachman and Palmer defined authenticity as “the degree of correspondence of the characteristics of a given language test task to the features of a target language task"
✔️ essentially, when you make a claim for authenticity in a test task, you are saying that this task is likely to be enacted in the real world.
✔️ an authentic test ...
🔘 contains language that is as natural as possible
🔘 has items that are contextualized rather than isolated
🔘 includes meaningful, relevant, interesting topics
🔘 provides some thematic organization to items, such as through a story line or episode
🔘 offers tasks that replicate real-world tasks
#testing
@Eltprogram
@Elt_program
✔️ Bachman and Palmer defined authenticity as “the degree of correspondence of the characteristics of a given language test task to the features of a target language task"
✔️ essentially, when you make a claim for authenticity in a test task, you are saying that this task is likely to be enacted in the real world.
✔️ an authentic test ...
🔘 contains language that is as natural as possible
🔘 has items that are contextualized rather than isolated
🔘 includes meaningful, relevant, interesting topics
🔘 provides some thematic organization to items, such as through a story line or episode
🔘 offers tasks that replicate real-world tasks
#testing
@Eltprogram
@Elt_program
🌿 achievement tests
✔️also syllabus-based test
✔️ tests used for achievement purposes are designed to measure the degree of students' learning from a particular set of instructional materials.
✔️ achievement tests are directly related to language courses.
✔️ most of these tests deal with a body of knowledge that the examinee is supposed to achieve through a course or courses of study ➡️ such tests are called general achievement tests .
✔️ the tests which are aimed at measuring, specially and purposefully , the detailed elements of an instructional topic , are called diagnostic achievement tests .
⬇️
diagnostic achievement tests are used to determine the strengths and weaknesses of the examinees in a particular course of study.
#testing
@Eltprogram
@Elt_program
✔️also syllabus-based test
✔️ tests used for achievement purposes are designed to measure the degree of students' learning from a particular set of instructional materials.
✔️ achievement tests are directly related to language courses.
✔️ most of these tests deal with a body of knowledge that the examinee is supposed to achieve through a course or courses of study ➡️ such tests are called general achievement tests .
✔️ the tests which are aimed at measuring, specially and purposefully , the detailed elements of an instructional topic , are called diagnostic achievement tests .
⬇️
diagnostic achievement tests are used to determine the strengths and weaknesses of the examinees in a particular course of study.
#testing
@Eltprogram
@Elt_program
🌿 knowledge tests
✔️ knowledge tests are used in situations where the medium of instruction is a language other than the learners' mother tongue ➡️ in these cases , the second language is used as the language of the tests to measure the examinees knowledge in areas other than language itself
✔️ examples :
a physics test written in English
Or
a psychology test written in English
#testing
@Eltprogram
@Elt_program
✔️ knowledge tests are used in situations where the medium of instruction is a language other than the learners' mother tongue ➡️ in these cases , the second language is used as the language of the tests to measure the examinees knowledge in areas other than language itself
✔️ examples :
a physics test written in English
Or
a psychology test written in English
#testing
@Eltprogram
@Elt_program
🌿 proficiency tests
✔️ a test which measures how much of a language someone has learnt .
⬇️
overall language ability _ global competence
✔️ a proficiency test is not limited to any one course curriculum, or single skill in the language; rather it tests the result of the individual’s cumulative learning experiences.
✔️ proficiency tests are almost always summative and norm-referenced .
✔️ they provide results in the form of a single score ( and usually two or three subscores, one for each section of a test )
✔️ examples : TOEFL _ FCE _ CPE _ IELTS
#testing
@Eltprogram
@Elt_program
✔️ a test which measures how much of a language someone has learnt .
⬇️
overall language ability _ global competence
✔️ a proficiency test is not limited to any one course curriculum, or single skill in the language; rather it tests the result of the individual’s cumulative learning experiences.
✔️ proficiency tests are almost always summative and norm-referenced .
✔️ they provide results in the form of a single score ( and usually two or three subscores, one for each section of a test )
✔️ examples : TOEFL _ FCE _ CPE _ IELTS
#testing
@Eltprogram
@Elt_program
🌿 placement tests
✔️ placement tests are used to determine the most appropriate channel of education for examinees.
⬇️
Sorting students into relatively homogeneous language ability groupings so that they can start a course at approximately the same level as the other students in the class.
✔️ materials should be appropriately challenging; neither too easy nor too difficult.
✔️ they are tailor-made rather than bought off the peg.
✔️ there is no pass or fail in placement tests .
#testing
@Eltprogram
@Elt_program
✔️ placement tests are used to determine the most appropriate channel of education for examinees.
⬇️
Sorting students into relatively homogeneous language ability groupings so that they can start a course at approximately the same level as the other students in the class.
✔️ materials should be appropriately challenging; neither too easy nor too difficult.
✔️ they are tailor-made rather than bought off the peg.
✔️ there is no pass or fail in placement tests .
#testing
@Eltprogram
@Elt_program
🌿 selection tests
✔️ the purpose of selection tests is to provide information upon which the examinees' acceptance or non-acceptance into a particular program can be determined.
✔️ administrative restrictions
⬇️
selection tests ➡️ competition tests
✔️ those who take a selection test either pass or fail.
#testing
@Eltprogram
@Elt_program
✔️ the purpose of selection tests is to provide information upon which the examinees' acceptance or non-acceptance into a particular program can be determined.
✔️ administrative restrictions
⬇️
selection tests ➡️ competition tests
✔️ those who take a selection test either pass or fail.
#testing
@Eltprogram
@Elt_program
🌿 aptitude tests
✔️ aptitude tests are used to predict applicants' success in achieving certain objectives in the future.
✔️ aptitude tests can contribute to making decisions on :
🔘 the appropriate major fields of study
🔘 learning suitable foreign languages
🔘 future occupations of the students
✔️ two standardized aptitude tests used in United States:
1) MLAT
2) PLAB
✔️ these tests do not tell us who will succeed or fail in learning a foreign language .
⬇️
they attempt to predict the rate at which certain students will be able to acquire a language.
#testing
@Eltprogram
@Elt_program
✔️ aptitude tests are used to predict applicants' success in achieving certain objectives in the future.
✔️ aptitude tests can contribute to making decisions on :
🔘 the appropriate major fields of study
🔘 learning suitable foreign languages
🔘 future occupations of the students
✔️ two standardized aptitude tests used in United States:
1) MLAT
2) PLAB
✔️ these tests do not tell us who will succeed or fail in learning a foreign language .
⬇️
they attempt to predict the rate at which certain students will be able to acquire a language.
#testing
@Eltprogram
@Elt_program
🌿 speed tests
✔️ items are comparatively easy
✔️ items are within the ability level of the test takers
✔️ time limit ( few or none of the test takers can complete all items )
✔️ each test taker's score reflects only the speed with which he or she has worked
🌿 power tests
✔️ item difficulty generally increases ( more items too difficult for anyone to solve so that no one can get a perfect score )
✔️it has a time limit long enough to permit everyone to attempt all items
✔️the aim is to determine how much an individual is able to do
#testing
@Eltprogram
@Elt_program
✔️ items are comparatively easy
✔️ items are within the ability level of the test takers
✔️ time limit ( few or none of the test takers can complete all items )
✔️ each test taker's score reflects only the speed with which he or she has worked
🌿 power tests
✔️ item difficulty generally increases ( more items too difficult for anyone to solve so that no one can get a perfect score )
✔️it has a time limit long enough to permit everyone to attempt all items
✔️the aim is to determine how much an individual is able to do
#testing
@Eltprogram
@Elt_program
🌿 direct test
✔️ testing is said to be direct when it requires the candidate to perform precisely the skill we wish to measure.
✔️ advantages:
🔘 in the case of the productive skills ➡️ the assessment and interpretation of students' performance is quite straightforward.
🔘 since practice for test involves practice of the skills that we wish to foster ➡️ there is likely to be a positive backwash effect
✔️ disadvantage:
🔘 as the receptive skills are essentially unobservable , there is disagreement as to whether it is possible to have direct tests of reading or listening.
🌿 indirect test
✔️ a test which attempts to measure the abilities which underlie the skills in which we are interested.
⬇️
inference is made from performance
✔️ advantage:
🔘 it seems to offer the possibility of testing a representative sample of a finite number of abilities which underlie a potentially indefinitely large number of manifestations of them.
✔️ disadvantage:
🔘 the relationship between performance on them and performance of the skills in which we are usually more interested tends to be rather weak in strength and nature .
#testing
@Eltprogram
@Elt_program
✔️ testing is said to be direct when it requires the candidate to perform precisely the skill we wish to measure.
✔️ advantages:
🔘 in the case of the productive skills ➡️ the assessment and interpretation of students' performance is quite straightforward.
🔘 since practice for test involves practice of the skills that we wish to foster ➡️ there is likely to be a positive backwash effect
✔️ disadvantage:
🔘 as the receptive skills are essentially unobservable , there is disagreement as to whether it is possible to have direct tests of reading or listening.
🌿 indirect test
✔️ a test which attempts to measure the abilities which underlie the skills in which we are interested.
⬇️
inference is made from performance
✔️ advantage:
🔘 it seems to offer the possibility of testing a representative sample of a finite number of abilities which underlie a potentially indefinitely large number of manifestations of them.
✔️ disadvantage:
🔘 the relationship between performance on them and performance of the skills in which we are usually more interested tends to be rather weak in strength and nature .
#testing
@Eltprogram
@Elt_program
Frank_Parker_&_Kathryn_Riley_2010.pdf
182.2 MB
Linguistics For Non-Linguists: A Primer With Exercise
By Frank Parker, Kathryn Riley
#linguistics
@Eltprogram
@Elt_program
By Frank Parker, Kathryn Riley
#linguistics
@Eltprogram
@Elt_program
🌿 rank order
✔️ arranging the scores in the order of size , usually from highest to lowest .
✔️ if two testees received the same score , we should divide the sum of their rank by two. In the case of three similar scores , we divide the sum of their rank by three and so forth.
score rank order
------------------------------------------------------
100 2.5
100 2.5
100 2.5
100 2.5
97 5
96 6
95 7.5
95 7.5
93 9
92 11
92 11
92 11
#testing
@Eltprogram
@Elt_program
✔️ arranging the scores in the order of size , usually from highest to lowest .
✔️ if two testees received the same score , we should divide the sum of their rank by two. In the case of three similar scores , we divide the sum of their rank by three and so forth.
score rank order
------------------------------------------------------
100 2.5
100 2.5
100 2.5
100 2.5
97 5
96 6
95 7.5
95 7.5
93 9
92 11
92 11
92 11
#testing
@Eltprogram
@Elt_program
🌿 simple or absolute frequency
✔️ frequency is the number of times a score occurs.
✔️ it is shown by small letter f.
🌿 relative frequency
✔️ relative frequency refers to the simple frequency of each score divided by the total number of scores .
relative frequency = f / N
🌿 percentage
✔️ when relative frequency index is multiplied by 100 , the result is called percentage.
percentage = relative frequency × 100
🌿 cumulative frequency
✔️ cumulative frequency indicates the standing of any particular score in a group of scores.
✔️ it shows how many scores fall below the given score in a distribution.
✔️ in other words , this index shows how many students received a particular score and less than that.
✔️ this frequency is calculated by adding the frequency of successive intervals in the previous work.
✔️ it is shown by F.
🌿 percentile
✔️ when cumulative frequency index is divided by the total number of learners multiplied by 100 , the result is percentile.
percentile rank = F / N × 100
✔️ percentile rank shows what percentage or students received a particular score or below that.
#testing
@Eltprogram
@Elt_program
✔️ frequency is the number of times a score occurs.
✔️ it is shown by small letter f.
🌿 relative frequency
✔️ relative frequency refers to the simple frequency of each score divided by the total number of scores .
relative frequency = f / N
🌿 percentage
✔️ when relative frequency index is multiplied by 100 , the result is called percentage.
percentage = relative frequency × 100
🌿 cumulative frequency
✔️ cumulative frequency indicates the standing of any particular score in a group of scores.
✔️ it shows how many scores fall below the given score in a distribution.
✔️ in other words , this index shows how many students received a particular score and less than that.
✔️ this frequency is calculated by adding the frequency of successive intervals in the previous work.
✔️ it is shown by F.
🌿 percentile
✔️ when cumulative frequency index is divided by the total number of learners multiplied by 100 , the result is percentile.
percentile rank = F / N × 100
✔️ percentile rank shows what percentage or students received a particular score or below that.
#testing
@Eltprogram
@Elt_program
Second_language_research_methodology_and_design_by_Alison_Mackey.pdf
19.3 MB
Mackey&Gass
Second language research: methodology and design(2005).pdf
#research
@Elt_program
@Eltprogram
Second language research: methodology and design(2005).pdf
#research
@Elt_program
@Eltprogram
The_Research_Manual_Design_and_Statistics_for_Applied_Linguistics.pdf
18.1 MB
Hatch & Lazaraton
The Research Manual: Design and Statistics for Applied Linguistics (1991).pdf
#research
@elt_program
@eltprogram
The Research Manual: Design and Statistics for Applied Linguistics (1991).pdf
#research
@elt_program
@eltprogram
🌿 computer adaptive test ( CAT )
✔️ also called tailored test
✔️ a test in which the selection and sequence of items depend on the ongoing pattern of success and failure experienced by the test taker.
⬇️
🔺If the test taker succeeds on a given item , one of greater difficulty is presented.
🔺If he experiences failure , then an easier item is presented.
The testing continues until sufficient information has been gathered to assess a particular test taker's ability.
✔️ advantages:
🔸 computers are more accurate at scoring selected-response tests than human beings are.
🔸 the use of different tests for each student should minimize any practice effects and cheating.
🔸 the use of computers allows students to work at their own pace ➡️ self-pacing
🔸 it is more convenient to provide exam results immediately.
🔸 the tedious problem of student handwriting is eliminated.
✔️ disadvantages:
🔹 most CAT items are limited to only objective recognition format .
🔹 there is the potential of subjecting test candidates to establishing levels of anxiety as a result of the need to manipulate the new technology.
#testing
@Eltprogram
@Elt_program
✔️ also called tailored test
✔️ a test in which the selection and sequence of items depend on the ongoing pattern of success and failure experienced by the test taker.
⬇️
🔺If the test taker succeeds on a given item , one of greater difficulty is presented.
🔺If he experiences failure , then an easier item is presented.
The testing continues until sufficient information has been gathered to assess a particular test taker's ability.
✔️ advantages:
🔸 computers are more accurate at scoring selected-response tests than human beings are.
🔸 the use of different tests for each student should minimize any practice effects and cheating.
🔸 the use of computers allows students to work at their own pace ➡️ self-pacing
🔸 it is more convenient to provide exam results immediately.
🔸 the tedious problem of student handwriting is eliminated.
✔️ disadvantages:
🔹 most CAT items are limited to only objective recognition format .
🔹 there is the potential of subjecting test candidates to establishing levels of anxiety as a result of the need to manipulate the new technology.
#testing
@Eltprogram
@Elt_program
🌿 multiple-choice item
◼️ advantages:
✔️ multiple-choice tests are administered easily to a large number of test takers in one single testing session.
✔️ in multiple-choice tests there is almost complete intra-rater reliability.
✔️ multiple-choice assessment has the advantage of being useful for measuring a fairly wide variety of different kinds of precise learning points .
◼️ disadvantages:
✔️guessing may have a considerable but unknowable effect on test scores .
⬇️
multiple-choice assessment typically has a 33% , 25% , or 20% guessing factor depending on whether there are three , four, or five options.
✔️ such items require distractors , and distractors are not always available.
✔️ multiple-choice items take much longer and are more expensive and difficult to prepare than more open-ended examinations.
✔️ multiple-choice tests may have a harmful backwash effect.
✔️ multiple-choice tests may facilitate cheating.
✔️ multiple-choice assessments are frequently criticized by language teachers because real-life language use rarely offers options from which speakers can select.
#testing
@Eltprogram
@Elt_program
◼️ advantages:
✔️ multiple-choice tests are administered easily to a large number of test takers in one single testing session.
✔️ in multiple-choice tests there is almost complete intra-rater reliability.
✔️ multiple-choice assessment has the advantage of being useful for measuring a fairly wide variety of different kinds of precise learning points .
◼️ disadvantages:
✔️guessing may have a considerable but unknowable effect on test scores .
⬇️
multiple-choice assessment typically has a 33% , 25% , or 20% guessing factor depending on whether there are three , four, or five options.
✔️ such items require distractors , and distractors are not always available.
✔️ multiple-choice items take much longer and are more expensive and difficult to prepare than more open-ended examinations.
✔️ multiple-choice tests may have a harmful backwash effect.
✔️ multiple-choice tests may facilitate cheating.
✔️ multiple-choice assessments are frequently criticized by language teachers because real-life language use rarely offers options from which speakers can select.
#testing
@Eltprogram
@Elt_program