<%BANNER%>

Pain Expression in Children with Autism Spectrum Disorder (ASD)

Permanent Link: http://ufdc.ufl.edu/UFE0022440/00001

Material Information

Title: Pain Expression in Children with Autism Spectrum Disorder (ASD) A Foundation for Instrument Development
Physical Description: 1 online resource (139 p.)
Language: english
Creator: Inglese, Melissa
Publisher: University of Florida
Place of Publication: Gainesville, Fla.
Publication Date: 2008

Subjects

Subjects / Keywords: asperger, assessment, autism, children, communication, delay, developmental, expression, instrument, measurement, noncommunicating, nonverbal, pain, pdd, spectrum
Nursing -- Dissertations, Academic -- UF
Genre: Nursing Sciences thesis, Ph.D.
bibliography   ( marcgt )
theses   ( marcgt )
government publication (state, provincial, terriorial, dependent)   ( marcgt )
born-digital   ( sobekcm )
Electronic Thesis or Dissertation

Notes

Abstract: Little is known about how children with autism spectrum disorder (ASD) experience and express pain. Communication impairments frequently render children with ASD unable to reliably self-report pain, social impairments limit their understanding of interpersonal interaction (and possibly alter the social context surrounding the pain experience), and perseverative and/or repetitive displays of behavior may influence the pain indicators traditionally associated with children who are physically hurting. Additionally, reports of children with autism having a 'high tolerance for pain' create confusion and generate misunderstandings regarding whether they are even capable of feeling pain. The overall purpose of this research was to explore how children with ASD express pain, and determine whether it is feasible to develop a pain assessment tool specifically for this population. In order to approach this global research question, a series of two studies were conducted to 1) explore caregiver beliefs about the pain experience in their children with ASD, 2) identify a number of potential pain indicators in this population, and 3) determine which pain indicators are believed by experts to best indicate pain in children with ASD. Findings revealed that pain is a serious concern among caregivers. Parents struggle to determine when their children are in pain. Study 1 results indicated that children with ASD are capable of experiencing and expressing pain, however their pain expression is unique. Study 2 validated this uniqueness by identifying pain indicators specific to children with ASD, and by demonstrating that indicators relevant to other, similar populations of children are not considered to be relevant in this population. This research supports the initial belief that a pain assessment tool specifically for use in ASD is warranted. Future research will build upon these studies to continue development of a valid and reliable instrument to assess pain in individuals with ASD. Accurate pain assessment is necessary in order to ensure that pain in this population does not go unrecognized, and thus untreated.
General Note: In the series University of Florida Digital Collections.
General Note: Includes vita.
Bibliography: Includes bibliographical references.
Source of Description: Description based on online resource; title from PDF title page.
Source of Description: This bibliographic record is available under the Creative Commons CC0 public domain dedication. The University of Florida Libraries, as creator of this bibliographic record, has waived all rights to it worldwide under copyright law, including all related and neighboring rights, to the extent allowed by law.
Statement of Responsibility: by Melissa Inglese.
Thesis: Thesis (Ph.D.)--University of Florida, 2008.
Local: Adviser: Elder, Jennifer H.

Record Information

Source Institution: UFRGP
Rights Management: Applicable rights reserved.
Classification: lcc - LD1780 2008
System ID: UFE0022440:00001

Permanent Link: http://ufdc.ufl.edu/UFE0022440/00001

Material Information

Title: Pain Expression in Children with Autism Spectrum Disorder (ASD) A Foundation for Instrument Development
Physical Description: 1 online resource (139 p.)
Language: english
Creator: Inglese, Melissa
Publisher: University of Florida
Place of Publication: Gainesville, Fla.
Publication Date: 2008

Subjects

Subjects / Keywords: asperger, assessment, autism, children, communication, delay, developmental, expression, instrument, measurement, noncommunicating, nonverbal, pain, pdd, spectrum
Nursing -- Dissertations, Academic -- UF
Genre: Nursing Sciences thesis, Ph.D.
bibliography   ( marcgt )
theses   ( marcgt )
government publication (state, provincial, terriorial, dependent)   ( marcgt )
born-digital   ( sobekcm )
Electronic Thesis or Dissertation

Notes

Abstract: Little is known about how children with autism spectrum disorder (ASD) experience and express pain. Communication impairments frequently render children with ASD unable to reliably self-report pain, social impairments limit their understanding of interpersonal interaction (and possibly alter the social context surrounding the pain experience), and perseverative and/or repetitive displays of behavior may influence the pain indicators traditionally associated with children who are physically hurting. Additionally, reports of children with autism having a 'high tolerance for pain' create confusion and generate misunderstandings regarding whether they are even capable of feeling pain. The overall purpose of this research was to explore how children with ASD express pain, and determine whether it is feasible to develop a pain assessment tool specifically for this population. In order to approach this global research question, a series of two studies were conducted to 1) explore caregiver beliefs about the pain experience in their children with ASD, 2) identify a number of potential pain indicators in this population, and 3) determine which pain indicators are believed by experts to best indicate pain in children with ASD. Findings revealed that pain is a serious concern among caregivers. Parents struggle to determine when their children are in pain. Study 1 results indicated that children with ASD are capable of experiencing and expressing pain, however their pain expression is unique. Study 2 validated this uniqueness by identifying pain indicators specific to children with ASD, and by demonstrating that indicators relevant to other, similar populations of children are not considered to be relevant in this population. This research supports the initial belief that a pain assessment tool specifically for use in ASD is warranted. Future research will build upon these studies to continue development of a valid and reliable instrument to assess pain in individuals with ASD. Accurate pain assessment is necessary in order to ensure that pain in this population does not go unrecognized, and thus untreated.
General Note: In the series University of Florida Digital Collections.
General Note: Includes vita.
Bibliography: Includes bibliographical references.
Source of Description: Description based on online resource; title from PDF title page.
Source of Description: This bibliographic record is available under the Creative Commons CC0 public domain dedication. The University of Florida Libraries, as creator of this bibliographic record, has waived all rights to it worldwide under copyright law, including all related and neighboring rights, to the extent allowed by law.
Statement of Responsibility: by Melissa Inglese.
Thesis: Thesis (Ph.D.)--University of Florida, 2008.
Local: Adviser: Elder, Jennifer H.

Record Information

Source Institution: UFRGP
Rights Management: Applicable rights reserved.
Classification: lcc - LD1780 2008
System ID: UFE0022440:00001


This item has the following downloads:


Full Text
xml version 1.0 encoding UTF-8
REPORT xmlns http:www.fcla.edudlsmddaitss xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.fcla.edudlsmddaitssdaitssReport.xsd
INGEST IEID E20101202_AAAAAZ INGEST_TIME 2010-12-02T11:09:24Z PACKAGE UFE0022440_00001
AGREEMENT_INFO ACCOUNT UF PROJECT UFDC
FILES
FILE SIZE 86616 DFID F20101202_AAAPPF ORIGIN DEPOSITOR PATH inglese_m_Page_114.jpg GLOBAL false PRESERVATION BIT MESSAGE_DIGEST ALGORITHM MD5
ea840a82f05a8b7fffd338d93072bbb5
SHA-1
f7c62dc3c5bf3212bd58314075c38ad4ee04ed99
27647 F20101202_AAAPOQ inglese_m_Page_086.jpg
07fc21981d2762a0b5583091958bded3
32881385024d879da101ea130d10b4e9acf27400
86004 F20101202_AAAPPG inglese_m_Page_115.jpg
17f493f096f7851f4a56796b6a6eab23
2c13edd010226765552e8b1d2339109c810d01e4
34657 F20101202_AAAPOR inglese_m_Page_087.jpg
90e9e152275a41727a42bcf7d2868bb0
d6a67d25395e3a39fae6435bf8d871c903e8f78d
49639 F20101202_AAAPOS inglese_m_Page_088.jpg
afd22423d79ceca686ced95f9fcebad6
6375f3fc1151d9fc3b766fd86fd2722d6f171ea7
42392 F20101202_AAAPPH inglese_m_Page_117.jpg
043b1126f3d6240b4c49672bac7cde17
07a4c2a53e08a0c12ed43c8903d31937e05bac24
35760 F20101202_AAAPOT inglese_m_Page_089.jpg
e664660f6688a34b784e47640cd79b3b
df59243f6e2340330000be2053f752117e3fa6a4
42156 F20101202_AAAPPI inglese_m_Page_118.jpg
685e3bc88ba2c611c3fc803cb015231a
7cf044020aad7b4ae2a7a2c3568abb2fcda26eb9
27567 F20101202_AAAPOU inglese_m_Page_090.jpg
4695da13eada5506e65a061063527f69
9c45a38b8ce0e079e79a7cfd0abcd5d07beaf63e
43781 F20101202_AAAPPJ inglese_m_Page_120.jpg
c41b28ad130c82357fad2d838e2bb097
158751199e85857a2c0bbf29b88171b89cf8cff1
43612 F20101202_AAAPOV inglese_m_Page_091.jpg
1a3bd58358873a18406c7bb1aa20355f
8ed043ccc89585b524fcc2e8be8f3f13af643d9c
84371 F20101202_AAAPPK inglese_m_Page_122.jpg
b5f5416f1e868f65a66b9380f2d2e9b3
3159839c7b4e080d5c1be6ad7d19c960d8c0f68b
38541 F20101202_AAAPOW inglese_m_Page_092.jpg
94d5aca1a560ff542e7119a06fa1bdd2
6389d0a39e05f2be09b9003e7cc2441b88918fa3
1051984 F20101202_AAAPQA inglese_m_Page_039.jp2
b05b0bbcaa18c35763fe4b6688bca9dd
69ce437f14574d0cdd79875a803da5c2370c2bfc
63220 F20101202_AAAPPL inglese_m_Page_124.jpg
aa277c04c67cf020befd1c657d838d16
19a1cdfc7c5e283d53b4813c4486135d43b4c104
82804 F20101202_AAAPOX inglese_m_Page_094.jpg
9c0185f0ba88b7f93d98917f1e231215
fe11b37297af23f8cb3c05cbc51577815b2565a7
1051969 F20101202_AAAPQB inglese_m_Page_050.jp2
7af26d678a70c0b9d1344fb0e7033275
5b72740e3bd2210cb19a9eea6d4544f78a83a681
13871 F20101202_AAAPPM inglese_m_Page_125.jpg
bcc98cd37c8a693a9e0d6be21b7dc635
8848f7b55373b0897ab418ee6f731de621d8bccb
86426 F20101202_AAAPOY inglese_m_Page_097.jpg
4d7f74c614d9c4dd90b51265c9da5c83
fe018e5f31a271db907fd93573a3556f91f37fa1
1051921 F20101202_AAAPQC inglese_m_Page_060.jp2
98ecd79cfa20b8e32cda14a8043f775b
a0861d8cc969fefa763bd805b5256c5b2f903b18
117419 F20101202_AAAPPN inglese_m_Page_126.jpg
4778e4be6a462b0ef6a72af1389d859c
af30ab1290f3d651c8df2dcd9a61026e1d38360a
84984 F20101202_AAAPOZ inglese_m_Page_100.jpg
c639a70a87cf6d89fa69e0f6df1b25cb
fed08213c20b56403c13f60bb961b92406aef69c
1051919 F20101202_AAAPQD inglese_m_Page_061.jp2
a5002c876ba02c1ad3b85318e37637e8
0c86396ac1572b199e7574385b4e33848a6f9267
93803 F20101202_AAAPPO inglese_m_Page_128.jpg
1f4cf9ad9a7a96c1cdd7688542e222ba
e6382ffa01fa522b89b3acc0fbd09cd54586c583
1051924 F20101202_AAAPQE inglese_m_Page_062.jp2
51cf42e235c79321987b82800d148914
a0457793be7e28610ef92dadbfd49b184999ccdd
107779 F20101202_AAAPPP inglese_m_Page_129.jpg
e1725030b7664e155e2b7d9b2a42eb80
e2cda2ed37d2a3deb02b97ab2a2e83328e7d24cf
1051986 F20101202_AAAPQF inglese_m_Page_068.jp2
464b83426cf3d3810bfd1876fe39c5ba
934611c53af70a577776d2f6ced9b8c7d52aae0e
77770 F20101202_AAAPPQ inglese_m_Page_138.jpg
f5c1d2352687e699c61f3a06c996122e
b60b3cfc9ccb89cfd4e21c8881d7979cbe66f983
F20101202_AAAPQG inglese_m_Page_069.jp2
ed3483f268608b03019ebef23ce43a04
24ae52c792c3e79c13cb499a4b44b3496922e481
30067 F20101202_AAAPPR inglese_m_Page_002.jp2
a5bcd4870015a2053d4ad3c121454f27
85b846dab480c07f403552ac6c89ec979f86ef2f
1051960 F20101202_AAAPQH inglese_m_Page_073.jp2
110a30764bf7e5877065a79c771bc4a8
5ec49bf99ceeac98e9a1195ca1800715aaaf6316
1051958 F20101202_AAAPPS inglese_m_Page_004.jp2
fefb2079ae08d2dddce8164f5abe7a89
b1cbb038c1fb14b657fc8541f4f4f431b13f08e7
1051965 F20101202_AAAPPT inglese_m_Page_005.jp2
703d8d14875aeea36480c5c3f6830eec
289387ee1980ab98f2d43a723e5a8b72eb812bcd
1051985 F20101202_AAAPQI inglese_m_Page_076.jp2
5858585fdf9fe7f40a396f89c6e49ebb
9e33347f6d47a56f4378da800c14011c703110e5
116644 F20101202_AAAPPU inglese_m_Page_009.jp2
83ea71cb41233593be725062adc98489
4f66b4aa486679f727622329fcbd44071cc19942
815097 F20101202_AAAPQJ inglese_m_Page_078.jp2
de35f0cb2a0573e9a62f90aea8ce32a6
73e683124a4721f874ffcacbbab5f4fffd340c3f
1051972 F20101202_AAAPPV inglese_m_Page_022.jp2
169caf158efbbe20ae7ae82914815b9d
8d8b2b856095b6ea48a0eee6ff59cde7a2bc1f8d
1051935 F20101202_AAAPQK inglese_m_Page_079.jp2
dbc384fad89681412a6cd1cce93ac753
56340960e52dba78cff1609bdea6a573906ac489
1051930 F20101202_AAAPPW inglese_m_Page_028.jp2
32f272a85b2e3cadbc06e02bba6d1460
07d9c83caf5049ecb34829cfdedb6f6f72fce347
F20101202_AAAPQL inglese_m_Page_080.jp2
b585e5af7fd0b2d5ece8365e985c5c1a
632fca4cd6516c49c2eb9a85bb1a59806e69376a
1051956 F20101202_AAAPPX inglese_m_Page_030.jp2
cdbb13cabe07604aa03ce74172a852c3
e543045b0cc51c4fb071cc22ce6d667078acc569
1051973 F20101202_AAAPRA inglese_m_Page_129.jp2
33d827c9132767c7d6a1a61db7f2a464
6425efdc4d12836913a20e39bd1ecdcb632704e2
F20101202_AAAPQM inglese_m_Page_082.jp2
f29f3da38800a0cb2636dd1b0844f110
1ce7e3cc0f2d13f558b49e56b389d3f7b87d371b
1051976 F20101202_AAAPPY inglese_m_Page_035.jp2
4c0f69a6e493a90c35cac03c2d040de5
72eebae2cd2e2cc5a5c4233ac0bdf4df081c655c
1051955 F20101202_AAAPRB inglese_m_Page_130.jp2
e6c925957a670fc6b8349f789bd23fd5
d4167276313b4616fcb61d84ffd6923e11babc08
F20101202_AAAPQN inglese_m_Page_083.jp2
4421c949ec4318d146eba070542a6086
699a6db1263952b8bbde91c823098219993b6148
F20101202_AAAPPZ inglese_m_Page_038.jp2
252f1474d32666c88985550074654066
0e49beaa99be0d40aca43533c177acef7193b14c
1051979 F20101202_AAAPRC inglese_m_Page_135.jp2
bdd8df180083c669bc3063c91d2f2ff9
350e732d88e3648a897f28e745853f11240e2e4b
668060 F20101202_AAAPQO inglese_m_Page_087.jp2
13aeef0906a7111512528df0c8d3d2ac
e6ea4d967cbb397c563bf9006d7917246fd28786
1051945 F20101202_AAAPRD inglese_m_Page_137.jp2
6895ff102df499fab9287c5847f108ba
855c6dc075013b7fbc0f7a42951c4c5fb6924d82
706397 F20101202_AAAPQP inglese_m_Page_089.jp2
e2ce1af1a59f58aafb085f8c4e111770
5b2f3fa49c2ec06fba763e4a0c570931ec4811fb
1022322 F20101202_AAAPRE inglese_m_Page_138.jp2
0b7a28d062ffb216cd510403199fb0ba
0db1bda2e8b38f41e0d3ab793ed304856a25f54e
517926 F20101202_AAAPQQ inglese_m_Page_090.jp2
686e25345351ea176340cd96e4ce457f
51a8641e4a3fe3e20e5ed21ba68ec61b52ff579d
883431 F20101202_AAAPRF inglese_m_Page_139.jp2
318531efbe18bc7b30c5c1e60e0b5f20
310da75db97d224374598c876b6de2a7a634d2bd
1051932 F20101202_AAAPQR inglese_m_Page_095.jp2
2a4f3f472fd4b99d637bbe8a302378df
b21a0b7e32bf11afb8a60b68acbd3ab02ef2059a
25271604 F20101202_AAAPRG inglese_m_Page_005.tif
a2e2d57694cc88adee528a67b260d930
2bf544868c40de9971a3f9673d3788bc075d4e53
F20101202_AAAPQS inglese_m_Page_099.jp2
7a03b719eb8708ba7a9f34f0e195ce56
ae36f8c97940be316ff8d3df03150d914ea74e39
F20101202_AAAPRH inglese_m_Page_007.tif
2ccc7ff960d0ca895409af1dc4090c5c
0de916b7c675e404a771da8900fc459b8824ae30
1051949 F20101202_AAAPQT inglese_m_Page_101.jp2
4ee557d59cdc0b62b1a4ef2a1be1f790
942745aa09293ffc7d625720266a6c3a19dd137a
F20101202_AAAPRI inglese_m_Page_009.tif
d2331099e3fa520dc4c9cd7635fe6db9
79fae86b362c44079bc02c271e9110027a793a58
F20101202_AAAPQU inglese_m_Page_104.jp2
3405faac7f5944e3c1d82c210dc30f4c
3966454904c50fcb8330447be0cdeefb1224a217
1051963 F20101202_AAAPQV inglese_m_Page_105.jp2
ada884985043df0fa9819f7377af3632
8f4563fb7316a1d560f0d617eb7a89981684cbd9
F20101202_AAAPRJ inglese_m_Page_010.tif
58e2e1af1a7ff89fa41beaffbbada2df
3ee7bd7ece1221a3ab7b31c9227c6410ae4e14ea
1051962 F20101202_AAAPQW inglese_m_Page_110.jp2
fa13c21d35abb183beca4800921747d3
d46f1134a6330fb18d751f7970817776c6d265fc
F20101202_AAAPRK inglese_m_Page_012.tif
962990f9231854b598c3307a8a84e1a2
837c4b2f7a835c4b4c601eb9e23a39772a3cca75
F20101202_AAAPQX inglese_m_Page_121.jp2
3e8cc03f8145c4bf57c0be72f1576de0
ca2edd846ac9bc981515cfb9368437082dac502b
F20101202_AAAPSA inglese_m_Page_048.tif
1a24b905babd1f57ce1fd1f60ab6ea3c
db0f3afafc92f423088822d9e877e2ce798624da
F20101202_AAAPRL inglese_m_Page_017.tif
302ec104e4bc4d0385e74b891f6340dd
e2c227d0b4905f6c66412401992ee8884e28ad3d
750589 F20101202_AAAPQY inglese_m_Page_123.jp2
df0f52a0fbb12d1d84c181a32dcd4ff4
ddfcaf47318af2f7819d684463374d6b644971a0
F20101202_AAAPSB inglese_m_Page_051.tif
34b7e695f5b6fb5045ac759a39ca2ee6
325f48a1d9928025157327ff1e385361ae207a79
F20101202_AAAPRM inglese_m_Page_018.tif
6e0d1738ba8f3fc50e124bb1ed92ad33
f7baaea5a409e4145deaf5a41a093e1c1369e205
F20101202_AAAPQZ inglese_m_Page_126.jp2
d63b8cf63debd327d8ee88e9e00e5990
dca2ed5457c401464e064a602a9d915fb81ebe85
F20101202_AAAPSC inglese_m_Page_053.tif
71d439ed3afe4c29de8eb00da249450d
cc5e45b0abc1b3eeb1ccd2ca31a356153b051816
F20101202_AAAPRN inglese_m_Page_019.tif
874fe58bfaa70d8c94d0227422ec6e7d
61dc79b44d7ab7ed29c41656d4c34c2758d95704
F20101202_AAAPSD inglese_m_Page_057.tif
9597c0e15da464ffeaae0d8a3bf13de3
8bcd28422d5bcec9a0a527198eaee100e08859f7
F20101202_AAAPRO inglese_m_Page_023.tif
bf98069baba55d5265cc801292b6fc8c
3aca8fa0507f3ea2b54174335438f2f0c849d6a0
F20101202_AAAPSE inglese_m_Page_059.tif
f7cd6a26ba5f968b532c5163038c0a30
c628ec09be7f6ac9d85db5c7a9beca046d8c693d
F20101202_AAAPRP inglese_m_Page_024.tif
b99c4c92f05cd7a3a605d668a316d6af
5cf7ee27ef9235ea30e923c45625ca43c5b2e6b9
F20101202_AAAPSF inglese_m_Page_060.tif
4ad1595e045dd519ed3483cc45ed5a6f
6a80f65e8248497359ec9992c640a76966f14e5c
F20101202_AAAPRQ inglese_m_Page_025.tif
160f54c0cd9c6adb8d905861dbb69608
9e5222b286e1b55b0d28ed7aee93570d61fada29
F20101202_AAAPSG inglese_m_Page_061.tif
c7417acd40765bc3bafac9abc30480b6
092949802ca75ee7762b43a396087d5b8db2b437
F20101202_AAAPRR inglese_m_Page_026.tif
be1592ca6967804c22445670939cf781
1bf661c8e6c771579d29631d5a24163982b45ef3
F20101202_AAAPSH inglese_m_Page_063.tif
a1f64de30862763565939167356ff733
6f5c7a8b19009f85b2394373853b4928553b2bba
F20101202_AAAPRS inglese_m_Page_027.tif
ab6793f2e3e9d38ac3192b4470afd778
564024c179cb549c0e932cc923ca9e2d7fc8f592
F20101202_AAAPSI inglese_m_Page_065.tif
c967feafa132396e5c5cbe68ec5304ef
690c34b003660626e391a71ccd003448ef0d0705
F20101202_AAAPRT inglese_m_Page_029.tif
45cb8e9faecadfcb362bdb37ef092256
929a745a5732097571d9760a9a7c49b27e1e8758
F20101202_AAAPSJ inglese_m_Page_066.tif
af8c8d3f80e0cfef1521679f791589e6
7da429db402c76bf843772962ae9746c8945c003
F20101202_AAAPRU inglese_m_Page_030.tif
b9f29088f3c57ed5c7aa8e0b15e31d74
960aafb7da1ce3e2920a10f6cd9fb09ce2708688
F20101202_AAAPRV inglese_m_Page_033.tif
a90813d57765bd2de7f6b3adcf85126f
366e11cf2f5ab159086066ba9b901871786d12f9
F20101202_AAAPSK inglese_m_Page_067.tif
7e0ef30b0bea9f0d788709749fd7fa13
b408f66b2b421907b79bed71f2d99200ff1b6ce5
F20101202_AAAPRW inglese_m_Page_038.tif
132a83afd69197859200369593afc0b0
eed9cdb67517e7b19748ea05dcc3f655b226808c
F20101202_AAAPTA inglese_m_Page_112.tif
8b91d94658fb88f78653f3988db654b4
1490a730a32efe3409d605a983cd9f81458bfc5c
F20101202_AAAPSL inglese_m_Page_069.tif
c4c315de0b9023df8d4dd1c82e88b0bb
ffa6cca1502fc4b9428c071ebb248e78a43840d4
F20101202_AAAPRX inglese_m_Page_040.tif
c478462d1d62dbbc0ece9eca51a0fd47
31fac0284f134931a5be3445026d49a575839b71
F20101202_AAAPTB inglese_m_Page_113.tif
8802bd3b002d27cd442a695978a442a7
c7683d02402bfa91c8a95afad80da5b6e1797509
F20101202_AAAPSM inglese_m_Page_070.tif
9c631f6da3247c2d4e8b4ec08811cb24
47c4c5f2405368e9efb099832c3af930060a29c9
F20101202_AAAPRY inglese_m_Page_044.tif
6cb04543b8dcbcf68c86ee448f417ba0
02ded0fe4a26343045feddfc8ba50cd580232cc3
F20101202_AAAPTC inglese_m_Page_115.tif
6498f34de4f6698919dda8ad49be9989
092966c9ee8f543eba4be8af77b3e36e9ed29460
F20101202_AAAPSN inglese_m_Page_072.tif
b5ec495cc9a4b170b4ddc1bd93b1c716
09377c084cff270a02cb8793d567172515ca4b06
F20101202_AAAPRZ inglese_m_Page_045.tif
f4bea36fc0ec0b9b24b5692085378b41
e277870aad734abb95465bde187a11637f760fb0
F20101202_AAAPSO inglese_m_Page_078.tif
1c80cf0b8745ac1257aeb174411ccee1
49105f31acf2b428b04bf822d5c7d3030d67e0c9
F20101202_AAAPTD inglese_m_Page_116.tif
dc6face828b1e71f184db346c26e9f7e
a3cad9ccbcd9ca6a37c9faf92954e002aa211497
F20101202_AAAPSP inglese_m_Page_079.tif
2d92bf28fa25a43b2b09f01515104ecf
94088119c287c8c80799b914903f09a6e063d3d4
25265604 F20101202_AAAPTE inglese_m_Page_117.tif
bd04fdc04691eb8e5af87b6a67318413
1955967e774c209e4b5c68a275f2357f1cdb8bf1
F20101202_AAAPSQ inglese_m_Page_083.tif
23c71283bade9169330b36f3450f5be1
b425b339fcfeb97c9b4e7c75874082a1ecd7ff7f
F20101202_AAAPTF inglese_m_Page_118.tif
773286b6650c5f340278acf2ba5d437e
f2c0917fa3f19f24e12a38266f83f7bbce2ab4eb
F20101202_AAAPSR inglese_m_Page_087.tif
225dd3615f88b28128ff25a7643d6d0c
cb35f8651f824c0e4e0037756d144e727847fc74
F20101202_AAAPTG inglese_m_Page_122.tif
a48aa40b3d2b85ad2a607ba3cd240d91
01960c93a47e001295d1d6e284faf00ffe1feaf7
F20101202_AAAPSS inglese_m_Page_091.tif
254d66b7d6a82bcac5909123c194b660
87335917e5cf135ebcc7909d25b51627e823ec7b
F20101202_AAAPTH inglese_m_Page_123.tif
87783e6fdac0c56e23e4164cb1b66d40
1d47d197247983a7a6babdb44c28fd7585dcd320
F20101202_AAAPST inglese_m_Page_093.tif
4860724c8c3139602ab81ee0d900bfcb
81bb9e2341294ded125d6773195a0b12f99fe302
F20101202_AAAPTI inglese_m_Page_124.tif
078a4cf0b3a63927cadd1f00ebabfd73
3249586f5c027d5febd43351a21208ba82920e53
F20101202_AAAPSU inglese_m_Page_094.tif
b47f966850bc0ff37947756191da884d
aa7d72e3e1d8e5350c2ff08d4e924fe114bdeff2
F20101202_AAAPTJ inglese_m_Page_125.tif
218e089113ae2c94a66642548d5dc948
7ffd3979bc35fd77bf78a1bea8aeb14c3c8bcc00
F20101202_AAAPSV inglese_m_Page_095.tif
43227d9c8c882af8b328da1e91973ba4
13c8a41f0272063ec3a320449c35a48323fd821a
F20101202_AAAPTK inglese_m_Page_131.tif
af31b3fedebc0891c8c09fdd9d40f479
43abe8d1a5e00ba5507a347f175b7fe83f536b1f
F20101202_AAAPSW inglese_m_Page_097.tif
ecc3926a280e5e37f1b8b84c7ad48b1e
4f2488e783da1172b2f67ceb8bebcadeb230776c
F20101202_AAAPSX inglese_m_Page_103.tif
5b81542bfe87c1fd47d23286edcb62d8
ecf1d22328b942823d2c38907d7e3edc58c5fcd7
7416 F20101202_AAAPUA inglese_m_Page_041thm.jpg
018cd64c404fb6fa81c0326db666f3ad
e548aeeaafda4e16420e11edf7234dd349cf117d
F20101202_AAAPTL inglese_m_Page_132.tif
9bb5bebb55926066e8c38421f2e94b67
7d9a968dcc1df6293a3c7d6b9d91dafd8d23580a
F20101202_AAAPSY inglese_m_Page_109.tif
9482fe8c28627163573d0f178b738a57
89ab805b05939ecc37dbe5a72a3d4b11440825e8
26498 F20101202_AAAPUB inglese_m_Page_066.QC.jpg
6e3e2f379791733233d84428aa0ddea9
0340b8a6ce5e1575d24599c3d08d59559bc4dda8
F20101202_AAAPTM inglese_m_Page_134.tif
d892c3d18a6e040f7472d0725a392cdb
bf20a2dca22a5e7e01cc14554de9bba0ca26d346
F20101202_AAAPSZ inglese_m_Page_111.tif
6b22c2243d25f6aeed4b589b1cf0c6db
4da71f99002e3f55a8ddec4b65682dfdf886a120
7258 F20101202_AAAPUC inglese_m_Page_020thm.jpg
bf4def7598b43c7d7ec5e32f7bd8c40c
1d88dac8ad84946a65d58b01208b9b1e7cc54d40
F20101202_AAAPTN inglese_m_Page_135.tif
5d8d0ec7fb0737e7a1529bfa862724b8
9d3880b6941dedbdebadeb82e26b1f44f2c78be1
7711 F20101202_AAAPUD inglese_m_Page_136thm.jpg
5ef6d30bf9815976ba8b1b2dc35fe73a
ea0e0997119f2b902cb974b22cc4940745db4300
F20101202_AAAPTO inglese_m_Page_138.tif
3c68c0b468fae7ef08afa429d8d2daa4
c1fea6b7fb8f84379f7317810510bbee30a31d4b
1398 F20101202_AAAPUE inglese_m_Page_002thm.jpg
a295645083e315a23a8a5f80117025a2
1df74773b0f04d45ba79efeb92a3447f09b07d90
28363 F20101202_AAAPTP inglese_m_Page_053.QC.jpg
ed8d159b0020accd09694f0ccc0e05c3
55a3c9522cf8e9885f43d398497132550404e47f
4340 F20101202_AAAPUF inglese_m_Page_078thm.jpg
db7c586d0a8c6e995ba737c896370a2d
94aab8ac59e65365eeb31d720297cd17255d543e
7344 F20101202_AAAPTQ inglese_m_Page_014thm.jpg
651fa8d5639938baf7df1b093884485b
49dd2345bef226551692f7ff7ef52059c2ae5962
27434 F20101202_AAAPUG inglese_m_Page_045.QC.jpg
d4a4e61777cca49a0d568d640784ea72
bd270659ba79543fde8665e95794d3f776759615
26482 F20101202_AAAPTR inglese_m_Page_044.QC.jpg
85cc14423c71e5da31e910f273581bd3
6d79a284487f73ad21c6f37b4efcb3c0f79d9b65
7476 F20101202_AAAPUH inglese_m_Page_095thm.jpg
50192a589316d656d08773a8ff045a6c
48f1181c57ce1ef5f0ca66a02bf799a84493cbb5
7274 F20101202_AAAPTS inglese_m_Page_045thm.jpg
52cc41a51df53794c15d4d8415d034b1
f589bf3bf830e5e9f030cd84d310c7d36192de5c
26381 F20101202_AAAPUI inglese_m_Page_030.QC.jpg
13b15b34817447107e390a875ed429e0
4186b6767f85e19575c0113a3a63ae79e6812c24
28157 F20101202_AAAPTT inglese_m_Page_096.QC.jpg
3a161c8d07c3d80dae78c31ac8c12080
971618a1897868a4933e98295fd1ad3b0ea70885
3710 F20101202_AAAPUJ inglese_m_Page_119thm.jpg
c5e6f3a2819f84a3e9acab8047fff2dc
15c3d17556c2bbc86b7db2ced69bcc5762059ba9
25163 F20101202_AAAPTU inglese_m_Page_022.QC.jpg
5a47a467ff1b440423e2e6a1a255ba96
f9a44297069abdda399bf57fea7b84f30cca4b9f
7723 F20101202_AAAPUK inglese_m_Page_050thm.jpg
65f7384b6de6486aa8876883305ba836
bb7376588df674d54ca37d14e7180361a5ddfb53
6553 F20101202_AAAPTV inglese_m_Page_071thm.jpg
fdda35427cc567e4231b812f5b235739
bf9effa66c0b153e70935985f2286475edbc8ba4
4645 F20101202_AAAPUL inglese_m_Page_007thm.jpg
782aa7e427f3e04921d4d99780944744
60c58316ef32171e926a16aa89690e8915f08b90
26953 F20101202_AAAPTW inglese_m_Page_059.QC.jpg
3130943a7dd68913ec1a85be41cd01da
278d025a8f3f3970d2bb5eb7f94b628da7029d19
151360 F20101202_AAAPVA UFE0022440_00001.xml FULL
33fa9355880d4c94e1a78155070c2c09
2f85c73e30b5a3856d4d6ada08e600951a42bfdf
26231 F20101202_AAAPTX inglese_m_Page_110.QC.jpg
5cc93180c675cbb499b86c6a492b263e
9c53cd72b010d1c85a96a00c99e953fe0b07a98e
6786 F20101202_AAAPVB inglese_m_Page_003.QC.jpg
923b6ba6479d406f7d4154c755ea5635
a7f6c84017a4fb0a4b37e05ef8a0bcedbd491674
7222 F20101202_AAAPUM inglese_m_Page_101thm.jpg
c9032e66f4658030393ce5a13b09fc78
9727a8584240a9a89f6e7e381cfaf781ef45ca41
7752 F20101202_AAAPTY inglese_m_Page_013thm.jpg
88f4e88283698dc30725155430be1ef2
25e1e53295052602394408358ff24991a0a34fc6
22411 F20101202_AAAPVC inglese_m_Page_005.QC.jpg
27f92deb662aae597856dd710fe88f1c
a2bbed103ee8861b9df0b5c3e5b35c6839e93234
28347 F20101202_AAAPUN inglese_m_Page_050.QC.jpg
8581f685933ecedeca86f5cdae8e4198
98d2014bbd760050b16da4db1552a5fe552bd7ab
24111 F20101202_AAAPTZ inglese_m_Page_121.QC.jpg
8f3bc9d33c3a367a8977569f1e4983aa
af6641b7f3a0d53fd276768030b61ec929764439
13083 F20101202_AAAPVD inglese_m_Page_008.QC.jpg
36718a4b6ecd3a525467ae678de9bcd7
39525bcc23ae0f91e783c1fd2365ac75c59843be
7395 F20101202_AAAPUO inglese_m_Page_048thm.jpg
762bb63f906468f20beeb863244c1630
75d3e43d4abb7f66237123a3e4c569a091b1cfe3
27065 F20101202_AAAPVE inglese_m_Page_012.QC.jpg
7bd837b777689b85d12818ae34ab2c10
b3df0c9f03015a38d5dd41e681f620305b926adf
7613 F20101202_AAAPUP inglese_m_Page_134thm.jpg
a3ff7c9064439970cb0e71dfeaca3da6
c2b2ad4a8a7eb2648d39a0d374e59b8d050638bc
7250 F20101202_AAAPVF inglese_m_Page_012thm.jpg
dbae6d64337a31dec0278b3361d05207
64148c22f2cc9f1742de6c30a9dca825550d228a
7412 F20101202_AAAPUQ inglese_m_Page_072thm.jpg
8e42b1cbcbc3880989eb785027cc6dde
b57822ce3ed821afaa322bfe45d6af732a3274da
28937 F20101202_AAAPVG inglese_m_Page_013.QC.jpg
71dd8a3145410c5b7c916175b60db0bf
91d917eb6db58b56f4956e41ee2c49df3d2a489c
7228 F20101202_AAAPUR inglese_m_Page_075thm.jpg
82ef000e8e0bc241793fefaae4d31012
250b908447dc77c7b6b27c9f97f69b40c44f3383
27426 F20101202_AAAPVH inglese_m_Page_017.QC.jpg
47736495cf4c5990d7ecdd0d74d4068e
c90b7ce75c19c192b29750c8d8c3fdc19a5b3799
7436 F20101202_AAAPUS inglese_m_Page_039thm.jpg
a1ae62a13a35dafc6f89fba0240b5596
40e1e5afb7b77350b98cd551d3b44f07eb36a7b5
27085 F20101202_AAAPVI inglese_m_Page_020.QC.jpg
1ed31abc10f85f598c8b126a4d74054f
7e03e1c13bcdd005e81403e612f4b16f5e5219cd
23523 F20101202_AAAPUT inglese_m_Page_071.QC.jpg
f2a98aa98e55fa9dc7b0f7c637a59d1b
e3f84363b2b7ca977fae8f8e33853e3b86b11c54
28064 F20101202_AAAPVJ inglese_m_Page_021.QC.jpg
54a8f8fe2fbd42e6ca9d30c39de59cd3
9b4ce699a11162fa4506e4a2690b404ba0a3718b
7143 F20101202_AAAPUU inglese_m_Page_035thm.jpg
8f54bb04b2b1dc452c8295d854f2d280
d496bb317b06fc9eb32364c0eb6412bbcc6338a8
3006 F20101202_AAAPVK inglese_m_Page_023thm.jpg
f5ce179009b6e5a4d7c4ce56da6ae742
5dd7227f7df334fa8bb301920693ed67f0c6fcae
7447 F20101202_AAAPUV inglese_m_Page_080thm.jpg
61dcad24e3e97ebe59d9593b35d5aacd
5b68fa98b998e59da25123d2094e7863e7d9da1a
27456 F20101202_AAAPVL inglese_m_Page_026.QC.jpg
dc39c94d2a7409f9edf10ccf0bfc27f3
74fbd1bb4f901ddf4ae6aee6137fc96bc7da7682
12986 F20101202_AAAPUW inglese_m_Page_011.QC.jpg
db962897d9ab6fcf49837263917ae4db
0aa0ac7273fbdd1bd693b9b80abc6e6aa56c107c
7497 F20101202_AAAPVM inglese_m_Page_026thm.jpg
94a196898482cd6cd2b88f882c2cdbb0
2d2daf72e1fca80df7a3cca300ed9e8c171661e2
7272 F20101202_AAAPUX inglese_m_Page_044thm.jpg
a1c8ecd6bf66a743178184c3300d9a0e
7b2a67a30a273fe00823e61d3a8acf9b901cf1df
7340 F20101202_AAAPWA inglese_m_Page_063thm.jpg
75b0ed9cfd1f12b3e357c5dd36a4744d
89e76b89f902c39f4eb30e283c58a5da9f6cf245
7880 F20101202_AAAPUY inglese_m_Page_065thm.jpg
8c171709369c054557a6f8f202f81ae2
8376aa0ab8c920aff2a67d3a87608a900bcf019c
28140 F20101202_AAAPWB inglese_m_Page_065.QC.jpg
c005866bc677a27e8faeecc0ca2ec936
c4a8502476ff10259551a5bb140f5a875c6a439d
7674 F20101202_AAAPVN inglese_m_Page_027thm.jpg
5f31e8b1f7af6cda274c68754a300a9c
b0c88f4e6c6d0c51b5bed959ffd624d30e223fa9
24423 F20101202_AAAPUZ inglese_m_Page_068.QC.jpg
7cdc9351f9656bd7407963655d3c5ce3
03e4acafd1e4f905c36bacd93587cb4e0650f4ea
7224 F20101202_AAAPWC inglese_m_Page_066thm.jpg
ca3b54f3ea05db889f6e5b6128a6a4a3
267d8dd41e788cef4a7c6f38d87ed4e6c1ccf359
7415 F20101202_AAAPVO inglese_m_Page_030thm.jpg
26b8694d21a8b5acc93ff82ec2080dce
c716696c6b9a546610266a3cc8e3f00b83d3da1d
6790 F20101202_AAAPWD inglese_m_Page_068thm.jpg
af6a424fcfb759fb3a7ee21135ae6246
f48c7d5b0625de8d682b743009e1481f875dda56
7311 F20101202_AAAPVP inglese_m_Page_032thm.jpg
ecdc7449049f5a0b11a3de6a66f8c2b3
d5b32b61121371da70480a819b4596b9411a3b36
26195 F20101202_AAAPWE inglese_m_Page_069.QC.jpg
c1829ebccb870e42ccf2e158ce8d82d0
06e597cfd572439ea31bb234a4dfbf959571f218
27072 F20101202_AAAPVQ inglese_m_Page_038.QC.jpg
45e975cf5be62c7e965fa568279e2be8
43625277b1bcccbcf06f2458dc02527727b2f39d
24689 F20101202_AAAPWF inglese_m_Page_070.QC.jpg
0321e844b70f51bb0e093b4a9b0b7b8b
671580e3d46514e8faa5ac3e74762107446903f5
27725 F20101202_AAAPVR inglese_m_Page_040.QC.jpg
397b5a82213bbc43ca8d15b4024f5c84
e3dbb4c1ac77ab0d426ddfb104e7b1d1c9f798e9
27198 F20101202_AAAPWG inglese_m_Page_072.QC.jpg
aa1840dbd94310e2cd303a462a814049
68c5e0859d6367a83d1de737484b2cec35d89e9e
27264 F20101202_AAAPVS inglese_m_Page_046.QC.jpg
3eeb223a506b7f663687f2f742beb26a
cb4cbf308c2643d1b5456bc342ab38bb0fbada14
25726 F20101202_AAAPWH inglese_m_Page_073.QC.jpg
61713acd67ded44b823957f4232663da
df03357c7b2035d198e14ef26fa123f4b3750d0a
27962 F20101202_AAAPVT inglese_m_Page_048.QC.jpg
7f85ff5df86bda572416b888dd13b5a2
e00908773ec71ccd5a12250e34f40112cab150a4
26235 F20101202_AAAPWI inglese_m_Page_076.QC.jpg
17ce5402c70b3f06a41b79759ab8d8ea
598d62812a528f5818cce667a1ca5d55601b2d69
7118 F20101202_AAAPVU inglese_m_Page_049thm.jpg
e88417f212eb7c30a307bfc5ccbf12fc
a6322bf9cd30a570ad4f7fb2cc018f37621107ff
6955 F20101202_AAAPWJ inglese_m_Page_076thm.jpg
c9628fff7b27cbe4e7abb22dc7744834
73bacafbff8bf02d229235ef64bb4b2fe1520688
7508 F20101202_AAAPVV inglese_m_Page_051thm.jpg
6505d94939a525d5a75a5c6feaec25ba
3eb1443457096db1204dedce6e0904990ab2dc12
23269 F20101202_AAAPWK inglese_m_Page_077.QC.jpg
9b33e3ad0b4ef8e241af1e1b4531b6bf
b3384eea30183ee142bc844ba0e59b341b8ad0ea
7401 F20101202_AAAPVW inglese_m_Page_054thm.jpg
e375babc7adcf471c261627aef6f5005
38f18f2c0beba747cfeadc32ebbf01fb5ef7245b
26566 F20101202_AAAPWL inglese_m_Page_080.QC.jpg
fef485a41f0004f90fcd4ad4e9573119
dfec2c0db0347a45240ad7fbd3670f42511f70be
7694 F20101202_AAAPVX inglese_m_Page_057thm.jpg
3f429c4da8dee8390258b6b595bc2ce7
dc50a1453c59422ce8f7b22297ce8683b89364cf
27204 F20101202_AAAPXA inglese_m_Page_115.QC.jpg
7b6ef2d94392ca4186130d2310e98330
23dbf3d5c4279e60dcf1260b5fc79dd1a3a5fd01
25624 F20101202_AAAPWM inglese_m_Page_081.QC.jpg
9915430baa44764f39d55d59e0675d7b
a57286af2932a5f0a73a9e9257f7772e4f2638d7
7356 F20101202_AAAPVY inglese_m_Page_059thm.jpg
ae6df60da0746f87a27e71592a5fe300
e9c9a6fb3fcdeab03aec37afffaeba4cd9daac8a
3977 F20101202_AAAPXB inglese_m_Page_117thm.jpg
b31abed55426ec22ee0945270bdeb005
205a4d4f6b91dff0dc9e9dca36ad35a3f0ac870c
6938 F20101202_AAAPWN inglese_m_Page_081thm.jpg
1a1716fc6a1c563c39e5a1aff95673b2
e4d845b238893669ec8e5f4d89597e228d540a6a
7426 F20101202_AAAPVZ inglese_m_Page_062thm.jpg
d8af05b14bf10bbb3bb1b9c886db523b
cc4e7d9255a7953fad1fc89bedc1d4a18cb1b52a
12484 F20101202_AAAPXC inglese_m_Page_118.QC.jpg
7b1e911511e5428f41587b969bf7de1c
6bbff3b7e3cfeaa56f97567d77419f58c2831b1a
12534 F20101202_AAAPXD inglese_m_Page_119.QC.jpg
040f637cda15bde29a6270983d172695
92f124d7a9441f83d4b5a15e284034717db99229
8210 F20101202_AAAPWO inglese_m_Page_086.QC.jpg
3ae848cece09e62f8a868b0e5f8e3971
40318f786d9f0a363b35950ab41ade7cb5ca1258
5990 F20101202_AAAPXE inglese_m_Page_121thm.jpg
22e14c3669e55c93e5f153a082812c90
e4dafc4684809d48b26826b7d923e9aae53b18e1
2813 F20101202_AAAPWP inglese_m_Page_086thm.jpg
b45e307ebc752750ef7c83bc04e34be4
360467c2203dec0b5567077cf74b7c6908b83663
6284 F20101202_AAAPXF inglese_m_Page_122thm.jpg
36b1bce538f5cb5c17b0be28c1694c16
70a839f8e72cbe9b3c58b1c5b0300901d4805fe8
10109 F20101202_AAAPWQ inglese_m_Page_087.QC.jpg
2f57331e8f77c13cb058cbddee9137ec
6948b06df309a56998e8a737aa6f8e53baf3fcf8
24922 F20101202_AAAPXG inglese_m_Page_127.QC.jpg
1a293b70250bca2912f1f154b7842c63
7bc496961c7f86180c51ee96849244473be22be9
3215 F20101202_AAAPWR inglese_m_Page_087thm.jpg
d4de13548ee3af499fc237630fb064b9
94988b9cb0f4eb8f61f69c045d4858048c1b5e25
6726 F20101202_AAAPXH inglese_m_Page_127thm.jpg
b95b2bdb61be54cb5373688b6eee74de
059d5d0d1d69afe43c123cc998ecde82fb70107e
12719 F20101202_AAAPWS inglese_m_Page_091.QC.jpg
15ffdba4baa91e1c5ac32842cdf4d978
3ec63d6938756eac15907d0f5ff80efd755b3ddb
28849 F20101202_AAAPXI inglese_m_Page_129.QC.jpg
56ee512e6fcfa6a669de994330dde617
df112100e6e3120d3edf88fe9b47682556ae38fb
2679 F20101202_AAAPWT inglese_m_Page_093thm.jpg
1341db2603e42004251bf6fe19aa83f7
6f43571f8f2cb684110c30c4b13770f6fa8db4d9
70913 F20101202_AAAPAA inglese_m_Page_123.jpg
a1b10eaccf82cade83a1fd39212f013f
586afe6e21c65f8322d8fa9b64bbee1b5d43f68f
27891 F20101202_AAAPXJ inglese_m_Page_130.QC.jpg
a34db55966d0c2861c859113f410fd56
19346e39ca2dc2bef4c5f4a669b169fe2469f4ff
26837 F20101202_AAAPWU inglese_m_Page_101.QC.jpg
4364a89add0c9d3a57fcc7038f1b59e9
94b9781c412c3c6170bcd2597f8b823ab6af0d44
27081 F20101202_AAAPAB inglese_m_Page_060.QC.jpg
70f7037eb5b2138a897c13fb3c9e2c74
49695857ea5c9f11f942ab04356b4345c05703d5
7219 F20101202_AAAPXK inglese_m_Page_130thm.jpg
aa55bfd42364831c702a0c8cf6c4c7c6
b132f9a1383adb9bd99ba69849ec3999ff446d4d
27984 F20101202_AAAPWV inglese_m_Page_102.QC.jpg
99abfc2337fbdedce940996f14d248df
5c0b54f0862933d765ab2b74494abe36b8918a7a
77160 F20101202_AAAPAC inglese_m_Page_084.jpg
c1b294a732d135cec2d9c3b43a969fa1
1df7e6a33da1d2e245fbe9284dc78e6de7159465
7793 F20101202_AAAPXL inglese_m_Page_135thm.jpg
064df00ebc0cb237c127540ac7ce1df8
ab9097a18dfe1a4671b7eb42e1c605376d120750
F20101202_AAAPWW inglese_m_Page_102thm.jpg
9e72ead7f00091e1d113ed99fe9b89f4
98fd00d002141fd9fc489842e8582bdf4ccb8ed4
7544 F20101202_AAAPAD inglese_m_Page_098thm.jpg
2a0d70dad35ce9e542bd0e9308a4d544
e589e6be9aa1f83b5c7bb2b1d862d284c89caf89
7656 F20101202_AAAPXM inglese_m_Page_137thm.jpg
fa2d3e3284b5c3bce65ed69feb5ee16d
711b8b211a69db6945571410276787b5588d1409
26024 F20101202_AAAPWX inglese_m_Page_104.QC.jpg
28a0e4f25ca5494f1ea95066cdd909f5
83d9ac685f17a80cdede814e23546afca43070d6
4111 F20101202_AAAPAE inglese_m_Page_120thm.jpg
5c87dc3b5fdb3cc20a2c8f877f6880df
b14e2266504a8b23f817edcacb9bc84ef4b1aacc
5406 F20101202_AAAPXN inglese_m_Page_138thm.jpg
5ed7a3deef6bcc7ca59e646a0ea82941
fb1d5a26d7a709b6f1345c1e9546a649e7a334a0
7379 F20101202_AAAPWY inglese_m_Page_106thm.jpg
5c9c0909a4250152d3129a314a4ba413
35667b9bc731a9fbd97f9847364c9de9e81e7770
27451 F20101202_AAAPAF inglese_m_Page_042.QC.jpg
8a1395d2f2334939c40e7b565afe5f78
f83f4e4453688d83ef015747f6aa1823c36fec79
28517 F20101202_AAAPWZ inglese_m_Page_108.QC.jpg
4e5b83fa2ec667b3d8e47aff47cd97fe
f6d7e8d543ea69f2f179f3d4a509f9d4e85e8ae2
F20101202_AAAPAG inglese_m_Page_001.tif
ed23a87853b5d578b8ed579d310fc1aa
4103c5acc43d6eb59e64048b3f63f07ed71eac11
27015 F20101202_AAAPAH inglese_m_Page_041.QC.jpg
f5f0d715d050e0125ff681102fbbb785
5d3d33f24e95e5d9971068c93a78db99629cf16c
27710 F20101202_AAAPAI inglese_m_Page_099.QC.jpg
3595a31640c89064c75610ffd2d6da19
ea896d1c65f8480eff812a4ae3a05d9e8d7a9c5e
85751 F20101202_AAAPAJ inglese_m_Page_054.jpg
188a9fc75c587cd89a36ef8dc5309bf0
a72b0c3417ad267958c178b5b28214470af646b0
F20101202_AAAPAK inglese_m_Page_035.tif
ae258a6b6d790a7cc0c234bc41111d42
3ba78d7a3ac86ac8a3a79c49276ef59aeee2b017
90644 F20101202_AAAPAL inglese_m_Page_018.jpg
c709abb8cef208a344478b3ceebd6bde
28d10dc68a3747c1d0838549446ae9961443c34f
1022554 F20101202_AAAPBA inglese_m_Page_088.jp2
74b4604348eaf82cf38edc4cac0d7a46
093fb3825b6893076f978ee239f5a8f8a421a98b
F20101202_AAAPAM inglese_m_Page_130.tif
68b59614ab5cf2e8bc2389467b333fc4
cee70919ebb55ae317ba9eb5b2970564920949ab
539025 F20101202_AAAPBB inglese_m_Page_116.jp2
309ce1546684c5e0066fb1951b3e832d
1bd6cf8b9b2ae1a9732f64fe0ce68e16b42fb045
F20101202_AAAPAN inglese_m_Page_016.jp2
ab43ea07524ebb8edd3a0900a4c7f44e
5241e8a3b426ca4ee39ea394db099c9454f3e124
F20101202_AAAPBC inglese_m_Page_085.tif
f29b4d8844a0047b0ce6bc6aa74eb1e1
c82f0bf1b9b1c24bdc8cf85cb2ae33f61cc6d9b2
321801 F20101202_AAAPAO inglese_m_Page_024.jp2
4c60cfecb1801e03377a70a8ba06fa44
0819fa99bcb83511de044aa6ea6555df43c8ce2a
88146 F20101202_AAAPBD inglese_m_Page_055.jpg
40affe6b8c30d6344587ba567d97206f
fea438adbb26d7bebb8fb3da1cd26dabc7c13a83
295464 F20101202_AAAPAP inglese_m_Page_086.jp2
73321ed704f85fc411b0b9dd85d372d3
3a636893931f0d801299bec38cb4e3186ecfb5ad
F20101202_AAAPBE inglese_m_Page_077.tif
5851614ea7b8d4b547a3810654dd37a3
dd37a94ed4cea3c945e3f7094a1cac251a0641ae
3669 F20101202_AAAPAQ inglese_m_Page_092thm.jpg
afc540551c6e71a3f8641de9d0c10375
448ce40dda3e8fe65fdc2a940ee610c255337ab9
1051915 F20101202_AAAPBF inglese_m_Page_064.jp2
d63290b39879cb8d4cc233da90aba621
9133d7e93b876319cba2b5eef8b7e9a62d537e30
F20101202_AAAPAR inglese_m_Page_121.tif
8a4f2a6e26330b27064a03e6db385a62
582aa4e0138e265b163b1bdb7ff79232e1bfcab3
7661 F20101202_AAAPBG inglese_m_Page_099thm.jpg
3c086734b946da27a71c5878d37fd02c
6948e7ab7075ddb26d7acbff4af0d380f3ee7b50
84133 F20101202_AAAPAS inglese_m_Page_039.jpg
16ffc1171a589e5d0022f2d64291d004
1e61057b16565443ad8046d456f73ab73a14fcc8
78268 F20101202_AAAPBH inglese_m_Page_022.jpg
dc3d69c332f24948468c6b2a4aac82c0
fb2227b366a09b0fb8cc099108960e0195307212
9542 F20101202_AAAPAT inglese_m_Page_089.QC.jpg
2cd5cfae5780b84a44b887757d4f475a
ae65dfebc7d0f5a43a8d0a6fca9e42cff924634b
85722 F20101202_AAAPBI inglese_m_Page_059.jpg
a85fc4861ddf29d7d90c8713a2948083
901ef69a7997be5663b6eaf7bfd8191f9191ef3c
F20101202_AAAPAU inglese_m_Page_062.tif
94e017d7d4982d5215c9050f24e67f83
7594eed36d52433a33f6171e7732eb1ba7cd553c
F20101202_AAAPBJ inglese_m_Page_080.tif
0dcd1453e5a3f2553c4b8d7bfecfb8c3
75b23206b66e23caea8cec78c52d5da5c25f2394
F20101202_AAAPAV inglese_m_Page_086.tif
cd6c0be3b069e9f532f7f711ff86b080
1be87da802faeb0cb9a49b2ece75bddc0de4b9bf
273500 F20101202_AAAPBK inglese_m_Page_001.jp2
58834786e99ee7b9f88e6a1314dc3756
ffac145dee2a20dd8c3fb634f8a6ed5ea7dea85b
1051952 F20101202_AAAPAW inglese_m_Page_114.jp2
0b5866fe39707463eecc8b67ce1b6cf6
8298001f6ed103bf3ec211ccdde1e73c574846e8
F20101202_AAAPBL inglese_m_Page_042.tif
48593289c1597f94ca4041294f9dd3af
77e9cf39f0a01df030c9fdf3641fe6c558e0c2d3
6785 F20101202_AAAPAX inglese_m_Page_004thm.jpg
ce9da91d4836b080fcb1b4653a310279
c5167e3f0a37e6bb41d3e6dd96f19c126c02af4d
26302 F20101202_AAAPBM inglese_m_Page_112.QC.jpg
d6d84a4d93903b1735871d02c1ae9ce9
3b6848991d4c2b9d879e4223d0676a6851af5c78
81288 F20101202_AAAPCA inglese_m_Page_063.jpg
4693206ad6a9c3acc9ab23c5fd1a2319
5b27833086682bd1b8de83fcfe32efb87ddf9092
19919 F20101202_AAAPBN inglese_m_Page_139.QC.jpg
1b07b4665ccc54a5c89ebacfdcfd2f37
e8cc52528cd70e288db546dc7f49caef201ce810
F20101202_AAAPAY inglese_m_Page_139.tif
37c9df8fd86801ed01967a6a7d507604
138dd1bebcfd647bac0cfb763a4ff1448b8635e8
79363 F20101202_AAAPCB inglese_m_Page_069.jpg
cbd3cd65a48813bcda89192e87508f64
b2b27c8edf06739dab3982f119e4f8fb6bdcfefc
F20101202_AAAPBO inglese_m_Page_022.tif
082294f513acfc371499c59d250a43c3
3774bd482a6061700c762821a8e2fb4a5be4e0c2
109493 F20101202_AAAPAZ inglese_m_Page_131.jpg
1c78b035c095f5e32a2092a2f0be273c
4baf15a8758049eeb874502ecfccdcc2f5f04b37
23919 F20101202_AAAPCC inglese_m_Page_084.QC.jpg
142f5836b61cd81ba19b19bac453d92f
6c3a7d4330e905a0f89af8061c83fb69a0537ac0
26437 F20101202_AAAPBP inglese_m_Page_025.QC.jpg
67eb5cd4881af7e4240cfa0bb6a0aadf
c3f70079aa5c525de547de00c4077cfd645ac826
1051957 F20101202_AAAPCD inglese_m_Page_056.jp2
8d35660b2430d797bf440b449229e41f
6d1d7e2d44ad597588e1a049e70d59836cd90824
F20101202_AAAPBQ inglese_m_Page_114.tif
c9f531fab0ec5970e3cefdede0919632
c6111dc2d78a0f91ede641ba0b4908d0ab513f50
1051981 F20101202_AAAPCE inglese_m_Page_108.jp2
78472a2116f189aa8d98750cb9b08e23
faa15ce3fcc753924b4a06a741dd0fe37f8abee6
364130 F20101202_AAAPBR inglese_m_Page_023.jp2
933bd72b1c3e1b974c9cd4301671b374
7f314e14166bedaec6d94bd4c19361ab54960887
893992 F20101202_AAAPCF inglese_m_Page_119.jp2
256f0fc0a0f0708e563ed3560b0d4a13
f02e18135e3e087490524cf0518036b99a6ba3ca
7265 F20101202_AAAOXA inglese_m_Page_031thm.jpg
2931e3ad673dc4a626d88bf25871f4b1
4159222d6a373eeb3ff85ed8766a4b7dd7ba0d48
27562 F20101202_AAAPBS inglese_m_Page_114.QC.jpg
9af3ac1b2c73de86f9bb8bdeec291490
6f8914931f2097997c10fb7062cf6aa555e95fd7
26485 F20101202_AAAPCG inglese_m_Page_035.QC.jpg
040b65b8e38b9371d4aaf633b558b21f
be0870aac578ecb302bd33803cca039436b84bdc
85371 F20101202_AAAOXB inglese_m_Page_020.jpg
ecdcaeaf27da807d3e25b14a99cb31c9
1aa04eaf1be531e6f502dfeae214fc1171c2dcc0
7506 F20101202_AAAPBT inglese_m_Page_018thm.jpg
6f0109ab4bc75a735b63278412ab5b51
7ddb64e9446407b10bb9ebb4ba705740815a0679
1051982 F20101202_AAAPCH inglese_m_Page_014.jp2
393d02e0b4388a3d6d9ec1cdf2844151
b4205bbe0315168f876eb850205eed24d3984dd9
26102 F20101202_AAAOXC inglese_m_Page_094.QC.jpg
ce05d068f4798ea1958126ec9088f195
5d59c1496156ac7b9e878b8cbbbebd584414a88a
F20101202_AAAPBU inglese_m_Page_084.tif
55a6e48676bdce2f1503f8bbefff33e8
fb4af30a170d217cfb89fd887f4123907796046b
1051968 F20101202_AAAPCI inglese_m_Page_044.jp2
7279d760c2b35fc564842995eef356a8
62696f2bc57f16d08be9ccb898888da6e15e7ac0
F20101202_AAAOXD inglese_m_Page_090.tif
91e267f34a4b5b8eac1669b8dafc883a
ca21aa1eefbd91fe08f6992d6c54e36e40888af7
7878 F20101202_AAAPBV inglese_m_Page_131thm.jpg
72a038dca283b09f9c5b370be0197752
da9e44b78c3e5526799b2711c7d97195a9f94678
F20101202_AAAPCJ inglese_m_Page_056.tif
6cfcb7971217bb346e06331d421ab27f
1aca8b1da94168ed35e32c43242fcb1d922139ea
85990 F20101202_AAAOXE inglese_m_Page_099.jpg
12dbc719690f9656ec82037be735b5a5
12df6d696be16e9d3c9d9c23cb45b1a32b0c3024
19888 F20101202_AAAPBW inglese_m_Page_124.QC.jpg
8c2709e20d6706979bc26ea0944efcee
670be48b262dd571985c28203e946b7786da604f
27349 F20101202_AAAPCK inglese_m_Page_028.QC.jpg
485638892ae32320835d7ea4cd773520
2f180ee0cbafb403742d5c2b26a63561b29fed64
F20101202_AAAOXF inglese_m_Page_042.jp2
7f614a2db097705e3a67e3e7c8abeb1b
2cec3897bc4af964200cdd16abcbbc3318ed2780
88190 F20101202_AAAPBX inglese_m_Page_019.jpg
121e7eefb674256acbf5653d952e9aa0
47c5cf6c6faa8a0d3aac806d181702196fae8ab3
23728 F20101202_AAAOWQ inglese_m_Page_079.QC.jpg
0ef0bf929b7441c547076cf740e70145
ede5b8fcf3228927fbb5456f6fb18e6b68b9198d
81870 F20101202_AAAPCL inglese_m_Page_047.jpg
980aac2c135d6bf29bf518afcc598c15
8c67ff8323395a05fa9e16e6f455c20f84381a07
1051917 F20101202_AAAOXG inglese_m_Page_019.jp2
dcd6dab5456254330228a3c508bd4c21
60850009456e202e400afb0d42bd5ba69e47496a
7530 F20101202_AAAPBY inglese_m_Page_058thm.jpg
f70079a4d7ca2b0b43340d881e11b0f9
5600ed9f5b6f1376469fd2340a90a4ed0264c4ae
4130 F20101202_AAAOWR inglese_m_Page_009.QC.jpg
b90ce2d37bd5555fc2e8cd1657da2f2b
295cdd500ce2d029f8dc79e248df17a339c9e04a
F20101202_AAAPDA inglese_m_Page_107.tif
1242540997c6465c17c30dbf3cf954a6
0a29a4e6124d9833a7df717d5699959108a6da08
450875 F20101202_AAAPCM inglese_m.pdf
17e9529f3fe32a80093c83499768eb43
8ce5912afdb8303618f02c8b9c35f2013374d19a
90320 F20101202_AAAOXH inglese_m_Page_050.jpg
e984a0a065f6e3bf513a76789ddfeb66
39f1cd71629ccfaabaef5a5bc88fabeeefb32bb7
7333 F20101202_AAAOWS inglese_m_Page_083thm.jpg
b9f7fbb11065ef77c00e48c63a7507c9
8ddcb2ed5864ec0b75aada2b8268c1cb07292765
6225 F20101202_AAAPDB inglese_m_Page_006thm.jpg
f983a4b46c2488db33fd7c55cbeedbfb
fa759cf72f2fdad5e8ea4eb7398033d686b8f8b6
73351 F20101202_AAAPCN inglese_m_Page_010.jpg
4bf852bbff652dd362a11ed2b627ead4
d98d6cfbc7e7def41a8308b2c9d31b44ba242696
F20101202_AAAOXI inglese_m_Page_034.tif
229e48e667f1f74b5a0a7de97923b3bc
c56d5afaf40bf0e9f0d67e8f066b1e1fe0714986
27651 F20101202_AAAPBZ inglese_m_Page_062.QC.jpg
23b8acd86a3f7973737c9197e383454c
916705a248edc151c0e53e145aef9c79b6995fff
3137 F20101202_AAAOWT inglese_m_Page_002.QC.jpg
eaa31b67c587062f7ade9fbff1fcdd75
8328c86704c7665855a3186843aadbd51f20606a
26827 F20101202_AAAPDC inglese_m_Page_032.QC.jpg
030269c7a9e6fdd24859a3b9766d287b
bedf4b31fe3416fb094843794d53a27c658f04a7
62861 F20101202_AAAPCO inglese_m_Page_078.jpg
3ba7f83ae8f77e8312c257cfd06cdab0
d92df91d4e3d6158acd9ec91aee1f12268ad3d63
87703 F20101202_AAAOXJ inglese_m_Page_098.jpg
5c683c5e1c2518e426ef40edbffd60de
d6868df1975d18a23ee1123b709fc1631f7c4d9e
10276 F20101202_AAAOWU inglese_m_Page_002.jpg
2fda1f7e93d6a36b0901b78a99979dab
61d810abba6e4cd360ca0c7a5df43aad55c93764
22500 F20101202_AAAPDD inglese_m_Page_123.QC.jpg
6cd18f1a402340f21c50977828e32fcc
0863f9f14e74994ccbc917cb4d7c15495a11b2f3
7331 F20101202_AAAPCP inglese_m_Page_085.QC.jpg
e87ac091cd860dfe029336dc4f7d124c
245543d32bf6b5cc643ab5ca5d03ff55231ff5bd
87098 F20101202_AAAOXK inglese_m_Page_042.jpg
f1bffb6cd25d48df1c5f3c2ae7d0fc17
dba34677203ba4a3be796e01e6bc7d3ccb61c382
28480 F20101202_AAAOWV inglese_m_Page_074.QC.jpg
702d322aa307ea3271dcc5cef860f557
1a45842dc49b9230dfc4948031316e6399e7e04d
7484 F20101202_AAAPDE inglese_m_Page_017thm.jpg
8e59d3d472b021e79605488eb08448d9
2dedcf352e09a1bf44f35f4bbed4eb6c2b13e114
26630 F20101202_AAAPCQ inglese_m_Page_033.QC.jpg
88365fe4cb2ec0e02db7def4a5f17e00
50d66a0436943de5d013a9c5bd8b5f565763bde0
F20101202_AAAOXL inglese_m_Page_059.jp2
d19d0ea55aeb474cbf773e0d59ddc7ae
cb818e13479314fa3ca355ce02a102fab7b2d25d
F20101202_AAAOWW inglese_m_Page_106.tif
dedec579a3f9318148f5c84d1cb024cc
4027c47cf7bef774dbb42beea01671cbffbb2e8d
F20101202_AAAPDF inglese_m_Page_096.tif
dd1e8885ea5b786efacb2d3d99710909
a2560eeabb14e5f5fb6cdbf156996efb44c79f34
F20101202_AAAPCR inglese_m_Page_051.jp2
e67df6469d191baf4d29f3814d129e13
ed9713e8acb98209591b4d094d5519e91377ca70
257480 F20101202_AAAOXM inglese_m_Page_003.jp2
0925f4a2366208405f7ce3d08c45a5a5
cd6c44ed75de5e945e584139a82f8145fc02bd6f
86156 F20101202_AAAOWX inglese_m_Page_072.jpg
3846bfb9505a122a9f4eedf7f72e6efe
badc4e0b6f62acd9f806605910f677a1ae9b32d6
8076 F20101202_AAAPDG inglese_m_Page_132thm.jpg
9de2dca1111d9bab9cc3b836f9a015be
0d5fae7061274e340c6e059ce47fad91c09b816e
F20101202_AAAOYA inglese_m_Page_119.tif
d8bad37397b644b29c7be81ff04855cc
27ba27e848b4c0df186764e3140457a8683c99bb
25833 F20101202_AAAPCS inglese_m_Page_061.QC.jpg
3ee252b52f3c4e8ae99b0344f18d801c
f07487d0194716cdd06480f7f3edb278a2efa121
F20101202_AAAOXN inglese_m_Page_081.tif
2d83bc329702a8e8fc6cadebe3166799
089e08b633e654d50ae03468ac29ad0445bbc7e9
F20101202_AAAOWY inglese_m_Page_136.tif
7c265c7340af2973f35eba57ddce01dd
42e0dd58178881da04fec130717a7c2820ca0e8a
1051944 F20101202_AAAPDH inglese_m_Page_074.jp2
745dbd36e05122a91f08a8eed73febba
a5230215ad2ab2a3a2770ed6ff616bf60e6311e2
F20101202_AAAOYB inglese_m_Page_133.jp2
36580a74b440e050786f0a26f2b5c253
b1cf2095a883bfe4ee6a4b5f64acdf290b77d0b6
1051940 F20101202_AAAPCT inglese_m_Page_026.jp2
b7d0553197cce610c47304fa243fdc65
17db37b21b0e1564052e9440d0bba1fb77c68376
1023196 F20101202_AAAOWZ inglese_m_Page_071.jp2
f7c1ec0f972e05b89555922739632e9c
a4a1690a1b4e5e60c8a379412c47346bebb63b9a
5822 F20101202_AAAPDI inglese_m_Page_123thm.jpg
d19020b5d851f909778fe1bf52dbd2a8
02a2d239c2077665e25d7bdfc83bcd07aa50a3a5
F20101202_AAAOYC inglese_m_Page_043.tif
30d12ff0981fe86807bc09e6fab755cf
e35a3ca76836afa2e9a91b7c6f89aefa064c471f
F20101202_AAAPCU inglese_m_Page_016.tif
249ca91f55c1e2fd39c0c5a631621390
eca44b437bee0cd3e5b1ba6a0e6c735c3ffeda24
F20101202_AAAOXO inglese_m_Page_071.tif
370843e724941b6b9992a7d1864ddbea
4f114a8df06dd2f74dd8932cf54658ea1c4dcf43
7414 F20101202_AAAPDJ inglese_m_Page_112thm.jpg
a1fb6ef78adf115375b5c06935f1eb88
5d8d1458d11da4a9a4f79351211b6376acfe8d2f
27284 F20101202_AAAOYD inglese_m_Page_036.QC.jpg
34e463d7a962e0f7a3f3b67ed2471be9
2ea0114f418129422d0c9a661f251ac543724a3f
27535 F20101202_AAAPCV inglese_m_Page_111.QC.jpg
205529e958fab2608d1484dd14909923
f9e9b9ab0ff4fb432c1de1198c3008c021a4a634
F20101202_AAAOXP inglese_m_Page_014.tif
dfad351c5aa9fefe657c56dca097ff2b
f9561425d160b415e000c66b7b9d6d1d285365b4
F20101202_AAAPDK inglese_m_Page_043.jp2
9cb6dd1939a28fd37b3fddf0a0dd7ff1
3f2e4d7ad734b3010d1a0ec59b90b9cc2370ac6f
88145 F20101202_AAAOYE inglese_m_Page_102.jpg
5e21052091f58dd58b573fc761dd6449
1f2737f49880122569f913d813feb744d9433995
F20101202_AAAPCW inglese_m_Page_075.jp2
65b52f792c4f5f2ba7b00483d7f891b9
267288581286db0dcb7ea530fcc0f12b3d858906
F20101202_AAAPDL inglese_m_Page_004.tif
a864580ad9a9a37fe3e2c8982c1f8914
b1153c8267b7c62707a2625cffec6b20b070de29
F20101202_AAAOYF inglese_m_Page_047thm.jpg
ddb729f671a22844e3990b7d71dfb9c8
cac786b4f726f09883f0459b7da02e5da4f9dcaf
F20101202_AAAPCX inglese_m_Page_036.tif
00bb9de76b110752f044d4a0bc08dac9
0e21bb8c9a59b1424ecdafec2648e3fbdd5e450f
7487 F20101202_AAAOXQ inglese_m_Page_037thm.jpg
122efb6ff32231e3995fc26773863d81
9e023a6f26b4693e54f7300a867cb71de08d5b79
1051933 F20101202_AAAPEA inglese_m_Page_012.jp2
62fe6cf8203051788c91bb66a4797e28
57b196b40da4b2b68ec800ce0012d1f2dd9c2aa6
7610 F20101202_AAAPDM inglese_m_Page_043thm.jpg
5c697c20cac756592dcb6586fb72e975
70d244774b51f66a011b4f73dee05e95ed9e5438
F20101202_AAAOYG inglese_m_Page_133.tif
8689c09a6a06f949294c06f8a48d12c1
0a3dbbd9f1e6e8752e5ed6a4c8dbbc0f22bf9ffb
F20101202_AAAPCY inglese_m_Page_003.tif
de1a5eb1ebb420e3501741d185769215
684d40ae448844ee4b651f4bdc60ab9a4007cab7
13519 F20101202_AAAOXR inglese_m_Page_120.QC.jpg
2d45d4fa58b817da232bdb57434e7d73
32a1cdd01f8eb377dd628c1cf050008713e98911
1051946 F20101202_AAAPEB inglese_m_Page_017.jp2
ee90d48db01df3e9116a5ead83c2deb8
503aacce11927ff64e46d2cb7a9ecd1f410c02ce
7182 F20101202_AAAPDN inglese_m_Page_128thm.jpg
faed07ce84d894244055f14dcb3658af
5f96597f55c41f0824c6321d6602fd7899c01e8e
F20101202_AAAOYH inglese_m_Page_045.jp2
b5eb2853ac914ebea89a04254a93bbb2
199f791500edb4422998e0d99ae90d8f165823b6
F20101202_AAAPCZ inglese_m_Page_046.tif
55a22efb5ef59bfa0c6401c678455d5a
aa69851568b32be83aa7086b45ed388c285b570b
F20101202_AAAOXS inglese_m_Page_082.tif
bf8906f39130ee54c82cbe71dbf766ad
8dbb0933fecf57145d77682581c489b4ed2fef26
86345 F20101202_AAAPEC inglese_m_Page_040.jpg
464355ee2dc83c786181357f0784723c
b9481f6443d6599cbe7089a395d95b33bdf9f107
1051967 F20101202_AAAPDO inglese_m_Page_131.jp2
fb9626f0c56f2b2703e5a7301e2a0dc6
07c41f2e5ceabd1c44a63e46723e37d56a7a26b5
1682 F20101202_AAAOYI inglese_m_Page_125thm.jpg
556af89582c94819089e91ce87ef0809
ffc84ad93c9ce54b933fa88649508c5297e72a99
27999 F20101202_AAAOXT inglese_m_Page_055.QC.jpg
9b0ac580461deb3e21b031bf70c85c19
d605e22eff306b7ec76fc72bcce1b5022028fbc1
4028 F20101202_AAAPED inglese_m_Page_091thm.jpg
39e620af96dc6120014e26665b141290
ceeb5af8ac179f08764326569dcbb806df90ccd8
856838 F20101202_AAAPDP inglese_m_Page_120.jp2
c275a4ea57e792c7334521a8b753e214
241af013aa3191da647cd65751bdd2348d51a848
7207 F20101202_AAAOYJ inglese_m_Page_033thm.jpg
8162e185ee08da109b4e7daa53e67b11
63d4cb6a6aba02cb2c19fafb758080bc4750805b
26856 F20101202_AAAOXU inglese_m_Page_054.QC.jpg
d482b64dee66cec3db8180dcbacae834
8263538856a173d0ada82928c3b02e33ed29863d
F20101202_AAAPEE inglese_m_Page_057.jp2
e9ea38d120bb2500ef6115c6bfc70fbf
d4eb7e0590ea3c15394f92e237eee3ad7c9ac63d
84608 F20101202_AAAPDQ inglese_m_Page_112.jpg
fee43424b6eed895e955425569952a48
604ef0df700c00170ead3ba7110996e102efec11
27972 F20101202_AAAOYK inglese_m_Page_052.QC.jpg
a11a3161b3d07402fd4586acb3952eac
df574b69926d1eb5d375d7202745ae0a86883fee
F20101202_AAAOXV inglese_m_Page_076.tif
e9bcd33e903b64bdf8c05d88aea332ce
2dd97fd4442434942357ad955dde99ff6b1dcb2f
1051977 F20101202_AAAPEF inglese_m_Page_055.jp2
f67f75e44005fd7e42b0d98f34ecd8e3
c0bff509c39e8c361b4f9d11027ff23300cef548
F20101202_AAAPDR inglese_m_Page_104.tif
7b72d70d48b9a33c4b146f234761bb30
6da5ad84ab2e1a10d49a734a2fd1c547adadceda
7407 F20101202_AAAOYL inglese_m_Page_107thm.jpg
c37703e7cfaaec8ba63d654bdc09c9b8
77d83b9c56dbb7f01099760b5c5392c95005a2de
90781 F20101202_AAAOXW inglese_m_Page_015.jpg
a862fafa11d9d10e7e9e0756313dc384
53c707254094dba8ac392688307e7f2b85b31fd4
1051959 F20101202_AAAPEG inglese_m_Page_109.jp2
4628aa3a740dd25af5a6681213f8009b
5877826cb4dd7c4842f4c17e186c485835338ee4
F20101202_AAAOZA inglese_m_Page_102.jp2
6faf503101f9cd664c10f987ddc3fc5e
43ab9bcb20ff76b30fcee2e48dd838ff3d0336ee
7565 F20101202_AAAPDS inglese_m_Page_055thm.jpg
d2e913695de82eea1c47cb49810e8069
d01a5d4200761eef7d170685221a44aeca3c124a
28395 F20101202_AAAOYM inglese_m_Page_027.QC.jpg
49b78e983840bece139c88a230856930
1368cfbbec47c58caa71433d6b5d2ae310f59aa5
F20101202_AAAOXX inglese_m_Page_028.tif
7b38e4009ce3f544ec3445ee806ca677
dbe0038fc141772b31412a132579c3ce9070f635
F20101202_AAAPEH inglese_m_Page_037.tif
9328d41186a6b13d8d1d9a6099453936
f5407c44e3540e3e628bf974751edb4b6f43f874
79959 F20101202_AAAOZB inglese_m_Page_004.jpg
8bd1d0f58669035dc07430b4e8e8b7c5
17fec3a290d6b12179947ddc6e1a438b69977870
18386 F20101202_AAAPDT inglese_m_Page_007.QC.jpg
ce35da196b16bae4e263703cb78f4367
d84b11cb2941d60b02f41a6f48189ad9a82dd62b
7144 F20101202_AAAOYN inglese_m_Page_094thm.jpg
7e449f7a9bfe07cdb3f9bd75e6f4d90f
0a6155b3a99681151358944469c2e9307a015205
F20101202_AAAOXY inglese_m_Page_055.tif
c0763a12a3f68a482f757fc3d7bde5c5
0cf9d7879190d639e93c229d0c007cde9e60d3d3
88262 F20101202_AAAPEI inglese_m_Page_021.jpg
64ab9b496d323054bf0671405deca371
7315a078f24d8bf11ae9e2a82d9ece03980f2091
5652 F20101202_AAAOZC inglese_m_Page_139thm.jpg
648ae54c75629a10563571da590ae185
33c39bca5f913b5cd8beb72bd3c7237481c6b02d
7686 F20101202_AAAPDU inglese_m_Page_056thm.jpg
2a28b94ffad0e006a18b0dc6f598bcb9
deaad7d62805d3e752e35c230f29074a93b75e2d
7248 F20101202_AAAOYO inglese_m_Page_042thm.jpg
7ff8a6d38fc33e85da92843c266208ee
e27bf5124e06eae06787afc2bc1b3ff1cb2c7733
F20101202_AAAOXZ inglese_m_Page_025thm.jpg
ffc37bef7f853ae3069e5ed3451b36e9
9812591addf1a1cd0aa66a1890b27537b365fc7a
27259 F20101202_AAAPEJ inglese_m_Page_105.QC.jpg
3c89d4ce31721e054ad51b055db1b6f4
f3450a48c18578761699381f29b16f801480ab64
7451 F20101202_AAAOZD inglese_m_Page_038thm.jpg
afdc0033f18ea5ba12df399122443382
0c9a4edd42a589a244f1d4fbfd55a4e7fa1d1a2a
F20101202_AAAPDV inglese_m_Page_137.tif
1b3d25d760839f8c030bc35d185216d1
5112910f52a95de2478e2f09b36034396a4b2fa8
F20101202_AAAOYP inglese_m_Page_068.tif
58f6d16827e7a0ab93903295ee11bd38
3b210f23a34ab8ca7069426b59ec4bfcb9a1165b
16513 F20101202_AAAPEK inglese_m_Page_078.QC.jpg
adb28c23dfaa05a2467c403e0232d561
b1ae43e5ebfdce2185b13da2d01ce642a223a43a
1051966 F20101202_AAAOZE inglese_m_Page_013.jp2
e864fac65f604de77a061edcd1f298d8
bc98e8c5095729687b2af77865020572ce191d08
7556 F20101202_AAAPDW inglese_m_Page_053thm.jpg
4f322852ac4c6c0bc8042a9a0f15b90e
5d16194ea0b0fcef8b006d9dc773e4d0e47561a1
F20101202_AAAOYQ inglese_m_Page_007.jp2
0e786d356488e6a1692356262efa5816
fdb2fe91ba7971315f538c2d1e9fdf94e06e2659
F20101202_AAAOZF inglese_m_Page_058.jp2
cdd11f7ce6982e4e4ab5ce98cdc77a22
240fd3501c5099f15dabeafb8f7910507904ab0c
24948 F20101202_AAAPDX inglese_m_Page_006.QC.jpg
18067a1d314f873119b7827e6df60a0c
8baa3d98386fda9a8f7f7c3f66f750cc277cbfb1
27694 F20101202_AAAPEL inglese_m_Page_082.QC.jpg
d17a658010199600279727060d7316b6
07443947a2e463f78dc2687bfe0777bc5b10f715
27387 F20101202_AAAOZG inglese_m_Page_103.QC.jpg
39c39ef3d2516dc6cfc3224aa4b0ca29
23e2e5a373d321805bbcaf6d9541c729268eb667
F20101202_AAAPDY inglese_m_Page_046.jp2
ce8c68a8a940cbf3bf41d3a0f7918e2d
bb218c7cc735ceb8d30f86a0de19462391c1c247
2145 F20101202_AAAOYR inglese_m_Page_003thm.jpg
40d4f6c695c50d7376434acd90e589a3
a3cfaf3971fd4b49fb8231c314dca6981623437d
1051937 F20101202_AAAPFA inglese_m_Page_052.jp2
48849420e3d1d4624005a5ba9b9ab22e
4bb802e36bdcfffbd9b347c80027e4e9e58c8f2f
84145 F20101202_AAAPEM inglese_m_Page_035.jpg
d1ab4c7fb90fcfc18bc6ef499848caf1
f6547d98c11ae1a44633d50e4a1c97e69f294fb5
F20101202_AAAOZH inglese_m_Page_054.tif
f34e47b0b9451b6051bf8be90e447659
3ac3db98de5c2a1c352e22eb98bf71b4cde0ee50
7962 F20101202_AAAPDZ inglese_m_Page_090.QC.jpg
ab10b4d8ac6668d0d0496c01b87e0048
80fa31c271c785fa06cc3ba9ddf8c624c72ed56e
7298 F20101202_AAAOYS inglese_m_Page_111thm.jpg
1956a5cbfb87276e868399a8edcc3035
00ae83ba1fc7caa491f6a31a3ccab15b2a279934
3701 F20101202_AAAPFB inglese_m_Page_088thm.jpg
4b6933f0778d5b264e398270a440950a
36d0c4638b8e6fa2b9e1e67ed8694fec5b2c8e32
F20101202_AAAPEN inglese_m_Page_011.tif
42721b91dfd19dc27394d0915acce1ce
25245af42d26ec641998eab6e09f4ac5696af742
10477 F20101202_AAAOZI inglese_m_Page_024.QC.jpg
f6cc2644fdb7c7a45df0706a4dcb1f70
c58c77549efe4d8a5c0bd224047430f731f40c57
41819 F20101202_AAAOYT inglese_m_Page_011.jpg
6addd33a9b72c11a9bfc23e947beda4d
776dc9403dfc34474f27cc9ae6fe65e071f0bf09
28430 F20101202_AAAPFC inglese_m_Page_093.jpg
5bd51e1772aefb4d2ae2306b41b28873
81927c7a61dcf513755425459f1423965084219d
F20101202_AAAPEO inglese_m_Page_110.tif
d35b3dc05c8f7042c59e36758f762a2c
ef148a628b9283bf0c527d28060ca248608538d8
85504 F20101202_AAAOZJ inglese_m_Page_083.jpg
cc89fff5093972fff71109c8497e324f
6b3b125df8bd982035f52023466f7557f18af146
29134 F20101202_AAAOYU inglese_m_Page_133.QC.jpg
ff03fbf6a76b203aec466338a035fc14
e2298c70f72fb855cd850c72e2b8fc2aa45452f8
85105 F20101202_AAAPFD inglese_m_Page_017.jpg
011ef6ae09119ac875b84001471b488f
a2e02120fb95c01ff14f990224eabb07a0c637ab
F20101202_AAAPEP inglese_m_Page_132.jp2
0d13ec7ab42dde18f72052fd3fbde1ad
8305c212d44f5958b002d5edb0a17162e9a45c17
F20101202_AAAOZK inglese_m_Page_111.jp2
efc1cd8bcc9275d152a9f5479bb264a9
4594f6fa0192907bb13d13f746c3952ce05ff084
84866 F20101202_AAAOYV inglese_m_Page_030.jpg
7e10f790a6919e4b54e5f1bddc0621d8
b2d991510c68b072f60e2d9065762b11258508e3
105821 F20101202_AAAPFE inglese_m_Page_137.jpg
3c02ad99794dbb6ddd867506236a7695
f436eadd42b70da011d2d14dd90609cf6ed9b8cb
7433 F20101202_AAAPEQ inglese_m_Page_100thm.jpg
a741cb2a4ee48a8b378f271eb1bf4018
f8bab2b6e9588139804e7e17db4ca0594e0db2a3
25713 F20101202_AAAOZL inglese_m_Page_067.QC.jpg
c42e0b19e25d4b36bb278cf8d286e249
f737c759cb6eaac8778bb851eb34ea13170eece0
1051983 F20101202_AAAOYW inglese_m_Page_033.jp2
993895f9b51c0cc308a9222bde94ee70
a9cbe356e224cce090994583c599e9e846e3f4d8
F20101202_AAAPFF inglese_m_Page_008.jp2
12491c4723d0e99c337f80523a07ebe5
9b35417db7a43343cfd96f562aa73fbefc9c3a29
1051961 F20101202_AAAPER inglese_m_Page_029.jp2
c936ffa8beabc16ad9068eaeaf3e0e59
99eb5cf98b6ee0424b697867c916bd57fcb6a1fd
7240 F20101202_AAAOZM inglese_m_Page_110thm.jpg
92faa85382bf71d5bf2e345368ee816c
9c7b42f2c5811619742b09c449d462976c077c65
27503 F20101202_AAAOYX inglese_m_Page_106.QC.jpg
8a8b83d2c7194499c8de894b5221afc1
af3d5d33d47ddf9d2ccb8ff146196e353abea306
7160 F20101202_AAAPFG inglese_m_Page_104thm.jpg
7ef305729b4f8c49f3b5b7f395e0e735
c55ad30cc87a5da955ceadc6db75f710c6759c56
25442 F20101202_AAAPES inglese_m_Page_003.jpg
b35b61f69fd1fa0159b809d98069c4ec
514282398957f446b13cc9d28dfd5253e963589c
1051948 F20101202_AAAOZN inglese_m_Page_047.jp2
abc94c90b8bacb2850d20d690313ee76
ca38ecd74a429d6c5f2c36696948d507b1568bb7
30312 F20101202_AAAOYY inglese_m_Page_126.QC.jpg
e452955a21953927650fbd59681ca276
e2569057bebfc1abbbe86c61ce8cc7047e4437b1
F20101202_AAAPFH inglese_m_Page_006.jp2
d0a58fd551f2652b59d2271b66cbe7ac
a768dd2ab8bd8d568b11bf465a3fdce2e04bb481
28535 F20101202_AAAPET inglese_m_Page_064.QC.jpg
eddc9b7a01227b249d2fdf1ec5da26d4
6aa9403de318b2c3d59776d4ce7ae5b4a6049062
12577 F20101202_AAAOZO inglese_m_Page_117.QC.jpg
4172d91c55bfb7fe99ce1edb60bbd205
0ea2d9bfdbef47699e29ad9c5fd23c6dd2367ce3
87464 F20101202_AAAOYZ inglese_m_Page_065.jpg
78a10a23dc681101ac7c3c0fbbf8b370
e8c2c7bc0a990b80b4bba7e0056fd143ae39be1e
30314 F20101202_AAAPFI inglese_m_Page_135.QC.jpg
9633df22aae3ade770a97fe35c36fb84
1f251a5e5a361097221c43fe06652c69a79e9445
F20101202_AAAPEU inglese_m_Page_006.tif
327350a2947900c4416ef51cbb538e85
17687c0f162393ff376eb19991d779fd443bea9b
F20101202_AAAOZP inglese_m_Page_049.jp2
8e668cbd00b5321a17dc12c0337ef812
5b34b665f42f84c36aa7a853decaffd0965f081a
1051951 F20101202_AAAPFJ inglese_m_Page_096.jp2
e5f0490d1e4ef4e1120cbbb7bab20bfd
77d9776e89ef1decb9d06867188b6a10d100f590
F20101202_AAAPEV inglese_m_Page_064.tif
21eb3a54398d9cf421d92dc756b0dd73
6fb5c1b1c0a6254c1eb267478a5ce8aa450bc214
87541 F20101202_AAAOZQ inglese_m_Page_051.jpg
ab8dd46fda098ab62005ac879079afef
f6bf61472b997e334183f89c18096f50c6813e04
3916 F20101202_AAAPFK inglese_m_Page_011thm.jpg
ebdfee5e07210c411e257e39933fe771
fe5791b87df288164f9c43c44c9f427010530fd8
83934 F20101202_AAAPEW inglese_m_Page_029.jpg
352c5cb3322bb1aea221f895cde91b56
cc14be4d537604bfb1c51733033b0700a7dff57d
F20101202_AAAOZR inglese_m_Page_065.jp2
56672bd4394f10aec25fbe38a1dfb6a0
dd564d7b44d39625e4669b20ce31b03c11f89a85
89401 F20101202_AAAPFL inglese_m_Page_053.jpg
03dcf185bc3fb217f14add91128a9941
0825f977093685abe8a7521a1d31fd83c268c4f2
25794 F20101202_AAAPEX inglese_m_Page_113.QC.jpg
5fee76ee110d53e27484bed55a6e06d2
13c90e594a984f354d5f88d1e786d4003563e852
1051950 F20101202_AAAPGA inglese_m_Page_048.jp2
e7c77bd70c6bea4921a5e6d5fc222023
0a9bc2240df010d23e7637c15b70e064a8974888
1051910 F20101202_AAAPFM inglese_m_Page_067.jp2
e0c0069c80ca41ef5963a50df2d6740a
a616596ef41cbf084a6658b867a9cf60a9fdc5fe
28690 F20101202_AAAPEY inglese_m_Page_134.QC.jpg
bea8f521f36aa697197fb58e737fc927
1d3b4fbbe345088da5ffe22f8af73d25e3eed7da
7637 F20101202_AAAOZS inglese_m_Page_133thm.jpg
53af870bfab4179faa70882818c6801c
82494b16c445b952b3bb7b9b25a76b65ebc52a0a
27443 F20101202_AAAPGB inglese_m_Page_034.QC.jpg
a9d93e45198fe796d1eecb087d9c7d30
f31c06f520c29e243455671dda7c281a7c182db1
29093 F20101202_AAAPFN inglese_m_Page_136.QC.jpg
b0dbd340e99f4c2c502df2c53995f720
775e99073cc8a6805a88133ef11402c3104229a2
26739 F20101202_AAAPEZ inglese_m_Page_029.QC.jpg
ab431673913ef85b40411cdcc4c9d281
c5318dbbfcf6d0eda7a1297fdf70f4c77d04b281
7586 F20101202_AAAOZT inglese_m_Page_108thm.jpg
5001d5e3ba52b70de850076c3f12d32a
d11b47a97e69314eee0f85f862b7d8f285ce71bb
495229 F20101202_AAAPGC inglese_m_Page_093.jp2
6926e8c954c4ea58774d51791a6a1113
69e705eeacfc97b0edfc962546ad043658b8464a
F20101202_AAAPFO inglese_m_Page_100.tif
c771a6dabd98c25127dc4334b72cd0da
755d3c1722872e23b349ddb4e567ee6ada0af917
26466 F20101202_AAAOZU inglese_m_Page_037.QC.jpg
0ebaf8ee1d6735869171cf54b48d55b8
7f9fde6aaab53e70129750710c3f39b7fb99939f
88855 F20101202_AAAPGD inglese_m_Page_052.jpg
e29b12008d045c56fb2b7c6e59f68e5c
767e3f87cf999eeda3e94d0348cab03c01dfcd3b
1027269 F20101202_AAAPFP inglese_m_Page_077.jp2
30d8963e26d4f78bb516a0eaf170c509
097be6a423aabe2aabe231a44a2e5ef39e7247c7
831514 F20101202_AAAOZV inglese_m_Page_091.jp2
72c75cf674653ac0d09f66b557334b9f
5c507149946b42210b0c0a115f83386036c8a0e9
3602 F20101202_AAAPGE inglese_m_Page_024thm.jpg
7ae5a76769f0151fa2133d20c0f0e3c1
78c97f22b5ad11221104136f7b187dccfe04edb9
F20101202_AAAPFQ inglese_m_Page_025.jp2
893f4c65fbbe477e40bddac62213b31e
7b3e867d9e01bfbad440d4c0c0d931665f019792
87108 F20101202_AAAOZW inglese_m_Page_096.jpg
ddfcce39d371c106ad29d38778edfb51
3c028e992a8a38201569e6dfbb77d5feae3ccb90
7409 F20101202_AAAPGF inglese_m_Page_109thm.jpg
c43a12538ad6fe6ea4cb0efd722551dd
6a3168dd4f6a55b7d798feeae42cc2a589b4e2a8
F20101202_AAAPFR inglese_m_Page_098.tif
7942d4867408c25a77215b5a56d54be2
dff38e6fc693970ebfcd7771c2e6d0f07ced2cfd
1051974 F20101202_AAAOZX inglese_m_Page_107.jp2
95007292428ba4888332875d212815b3
7edb6b24145f9ab70c48ef8cc7ca635b552dd667
85310 F20101202_AAAPGG inglese_m_Page_041.jpg
a0cbd101786187ae38780a668a3a51a7
c17ab9222c31a4c5b76ec27c9ec6297e901c3089
F20101202_AAAPFS inglese_m_Page_134.jp2
3dec4b02260c426c0840460d20072b9c
545392fc8b142f35a1b10f1051029e7c7184f65e
1051971 F20101202_AAAOZY inglese_m_Page_106.jp2
73f78b54517d9eac67e1c465f72f6254
abc0fcd53691426775df516148f1cb89c16885be
7681 F20101202_AAAPGH inglese_m_Page_129thm.jpg
d0fec4a299c2306a79f3c842bb5371be
fb1793e01db530d1179712136bf08e2fdf0ecb75
89472 F20101202_AAAPFT inglese_m_Page_082.jpg
e056f9cad6be12ca8c05bbcbc6476ab3
a09d1a46eaca1f1c60daf744862fcc2b589bea1d
1051927 F20101202_AAAOZZ inglese_m_Page_081.jp2
90423ac330bfa95279bb1f7b03a46720
c2d786f699a06afdf7b2832b3a0b41dcf86fd91e
F20101202_AAAPGI inglese_m_Page_021thm.jpg
e8da54274dbe9970c9b43df7effdcc72
40d85720602e6054430513160f0be32d83c6e63a
28238 F20101202_AAAPFU inglese_m_Page_057.QC.jpg
c87a2c150c5ada4b897ba96afd8e8266
12d33736d7ea1496b3e0e3236be27a004263ea8c
F20101202_AAAPGJ inglese_m_Page_036.jpg
7a710f86264cc7df6d08cc451f0c8f1b
97ac88b17943567c0b3ca8f11e2ba91e12220f07
106864 F20101202_AAAPFV inglese_m_Page_132.jpg
bdc40fb208b4cc99b6cb7aa1d2898d37
bf7b5543efbb2a12d64016a962b8afb704a01d39
24687 F20101202_AAAPGK inglese_m_Page_122.QC.jpg
b22b3a753c317cbb6fe2d602ea6aafc8
2563a79d75580f1d03eadd2c162dd99d534ceb13
85436 F20101202_AAAPFW inglese_m_Page_107.jpg
40c3198707431df02b107753d2c1c7f6
48c164f3d5e9b57253f84c43fb3620a69a6d045f
747733 F20101202_AAAPGL inglese_m_Page_092.jp2
42cd744d4fd03b814b2e9e00cc116c79
1b7793b40e9fae45c66b3cf54c772cb82735a4fe
5630 F20101202_AAAPFX inglese_m_Page_005thm.jpg
d4e0cea0d9f0434d3c0ea44fab872b50
f2308c9e91a3eb8de57551f8c48e8cd1977ed7d7
29910 F20101202_AAAPGM inglese_m_Page_132.QC.jpg
1a260a5fd69625267b2696a69e50892c
d383b915188878501e3ecb8c544f47dc6a4cf695
7583 F20101202_AAAPFY inglese_m_Page_046thm.jpg
fc632af11b11e0ae6651f859e10b80ee
f181bfa87786faf98391798fc29a94c1dcdf82e2
975865 F20101202_AAAPHA inglese_m_Page_010.jp2
21ca3346072362f5ea00150b73ef4cfd
8cbca2569dec581a276bba9dfcd8ee5053801010
27099 F20101202_AAAPGN inglese_m_Page_039.QC.jpg
6f26e65dbcebd500a61408a666ee9214
3a898d05cd0942f1a5e7a5b74844fac816256bd3
42428 F20101202_AAAPFZ inglese_m_Page_116.jpg
358426f659fea059596761c411640cac
2ceb43a66c7a9068e2ec7a9f0dd3eb6b475ed42a
6831 F20101202_AAAPHB inglese_m_Page_070thm.jpg
8ce51ee11e1094de327206f84d0378db
f50e015f52d3600af9de5fa46aa95224c1dfdadc
F20101202_AAAPGO inglese_m_Page_129.tif
69b5f8a39bd3e049063eb52372042553
9ec27679179937897cf1452e60fa87824dbc2196
11067 F20101202_AAAPHC inglese_m_Page_092.QC.jpg
aabdc0aa08426f99ec01b05be8ad9b4a
aba0696c6c8407cee8d3d4aaeff4e702d1e0ec0b
F20101202_AAAPGP inglese_m_Page_072.jp2
5ba675c2bdd7ae2218b2046bd29a04c0
28941133c4e5955d9459bcda10035862ac3c4518
F20101202_AAAPHD inglese_m_Page_088.tif
93ae84b84fb89e69b2cdd9fddae82f0b
8f301431bef1d4ca6c90119b89fcb5928bff217c
F20101202_AAAPGQ inglese_m_Page_052.tif
78a0bb20335a640f8abf320c5a983754
4e8849d5d3a96ba4c9feeb4c127a3b9d09a438a1
3648 F20101202_AAAPHE inglese_m_Page_118thm.jpg
e060925f9c8121c8e488e4927503fc0d
92933475d936f1a2ea5ba5b0aef4834c452f3250
4567 F20101202_AAAPGR inglese_m_Page_125.QC.jpg
4ba1e9e745b3ab31ec187819703e2e2e
8794a47b6d04fdb9d133da9613d7f0fd46524c98
27933 F20101202_AAAPHF inglese_m_Page_098.QC.jpg
26b80798b4bc34cbc519fb5e7d71ad23
78b57d686c3a85814bc4ffda2e1d048163ed10d5
82440 F20101202_AAAPGS inglese_m_Page_075.jpg
10705a62821f7bb09fced909ddc9478d
b5894f5acd6f3022a3964cfae0d9e43e1031cff8
27590 F20101202_AAAPHG inglese_m_Page_083.QC.jpg
a6bd986d946e3416443e484b8b2495a5
03b3cbe19ae723da6421a79c3a35ed25a27654a6
27018 F20101202_AAAPGT inglese_m_Page_016.QC.jpg
d4bfdb9242074c198d385f2fc6365f63
864e922943c180976f51949b78e722390bac42b1
7630 F20101202_AAAPHH inglese_m_Page_103thm.jpg
c08421838aa59e13ed812d22c8cd22e2
b5043eb5de7c8dd85561f0e5d6ee619c4ccafa45
F20101202_AAAPGU inglese_m_Page_127.tif
35b46ad4c18ac3f769d1742eed3c0d04
01ac6d80ac643a05b314fdab0cf2a064a4c919a2
27012 F20101202_AAAPHI inglese_m_Page_107.QC.jpg
751669c7f2d175ba52637ffddb5d18b1
82046f0c060681d925fa1ab1ca0e30b87b34fa47
103162 F20101202_AAAPGV inglese_m_Page_136.jpg
72a53481278bfa2fc34a2d94cb0d630c
92054bbc6080874402fa7d2bb68876ad4491cb07
83519 F20101202_AAAPHJ inglese_m_Page_101.jpg
86a2e448a2021d17177b650e0aa0abb8
20afe09cff1469ab59965fe47726b3268666e08c
7026 F20101202_AAAPGW inglese_m_Page_061thm.jpg
8c42dac7b075dae7660858110f8e09f6
cb4f81a781655a418e2b79ee913bd6784e13e1e7
808306 F20101202_AAAPHK inglese_m_Page_117.jp2
4ab1bc245d426438b7cfdf76529dcab1
11bbd97095291b2cd56ac60a745e6b6edbe65838
F20101202_AAAPGX inglese_m_Page_114thm.jpg
b0bd9926e5101529d9d9dcadeb8ceef6
d1d4e1aaa144a089694df37741aba58a958afb8e
7354 F20101202_AAAPHL inglese_m_Page_074thm.jpg
ddc2d6b2047358f4735269b665db4683
e90de84bf6781c041636539e4808204ebc1a38a8
83038 F20101202_AAAPGY inglese_m_Page_061.jpg
aa9fcb45397ea2f85ab6246cb62d126f
d5a5e081cd92df4494dff7237696db4ae36f0b35
89817 F20101202_AAAPIA inglese_m_Page_074.jpg
0c92cf09df78d02083adc4427a452eca
54c794c3a839f342b6b17bf7ea77dfde28a97739
F20101202_AAAPHM inglese_m_Page_008.tif
8d0459f72ec1223cc190079f6c14c50b
19e80fc5d6cfc2eba44e40642142b759cf17d707
7317 F20101202_AAAPGZ inglese_m_Page_029thm.jpg
bb216773ced850b03770fa07f5c8b9e2
1c3d3114e07866f049a1e8e4e8383105c18a8c26
244382 F20101202_AAAPIB inglese_m_Page_085.jp2
1f94bc637dae35a68516478d46840b39
628d5aab39c8a359ad1553ecb8303128ff10edb8
1051980 F20101202_AAAPHN inglese_m_Page_041.jp2
666642c824255382a1f06e49c5fe4083
a91943b278c7b0abf0c3b392cb86ff612289d63d
7263 F20101202_AAAPIC inglese_m_Page_034thm.jpg
631d039be49e895d2a486400ed6dbfd7
d5b36144e2f1ff1905bd57c8bd0195e68a1f2de7
F20101202_AAAPHO inglese_m_Page_058.tif
54e087d14e11353faf08bbda44cbb887
d2299489fb49aa81bf1f85e54aab8f352264f1b4
1051964 F20101202_AAAPID inglese_m_Page_032.jp2
25ad99624ce40a655700427b98bc89b2
86fe1cce4b116c0cc7ea63a989c789014e13a1cb
25440 F20101202_AAAPHP inglese_m_Page_047.QC.jpg
0d796b3abd110160245483b6f21c5470
703201f05f070e71a420fcce89af102a1d5bce48
4013 F20101202_AAAPIE inglese_m_Page_116thm.jpg
633be77e0075e888399f7738018b921d
8e4ddeaf81b3fe373877509e02634f180be87836
101732 F20101202_AAAPHQ inglese_m_Page_006.jpg
5e2da56db36678b699c32629382b9fed
3d638f4e97256106095c7a7c180cfb69364c644f
7170 F20101202_AAAPIF inglese_m_Page_073thm.jpg
65a7f235519520b2c88fb8a776347e65
d321cce0919fd079a24c675c97f324642f5964f8
6483 F20101202_AAAPHR inglese_m_Page_077thm.jpg
42dfdaf637db0e9dad95e56a84ba4e2b
c436c12b5ccb064de378424ee0de7b92f4c97501
F20101202_AAAPIG inglese_m_Page_070.jp2
03dc20befd1aefa55ed1c20ef4c8902c
13a50bc552a7a091b84179f2ae525259b0f095a5
7672 F20101202_AAAPHS inglese_m_Page_064thm.jpg
768498e431435789384f9498c3066650
e2bf66073e37bd54e78d4b0b64eda4ec8aa2921b
27339 F20101202_AAAPIH inglese_m_Page_109.QC.jpg
5916b182e20b1bbb6405b187039ebbaf
570370baaa56a25cd8f443ebb354fa5944e9d1ec
1051942 F20101202_AAAPHT inglese_m_Page_127.jp2
ac8387fb72bfbf0a0d1d3e8fd3cb947b
a17e450686e3ba9833ebd2f9590209df97504136
27643 F20101202_AAAPII inglese_m_Page_097.QC.jpg
3542d270985a81ab70a07768d7213430
f696ff32001d1eb53458373e0a83d30c73e8caa1
F20101202_AAAPHU inglese_m_Page_034.jp2
f3e6e1e5da3ec1e35e783cc783a074bc
a38865bd98bdb84728e9f8d6ef5d0cd2bb857297
1051904 F20101202_AAAPIJ inglese_m_Page_027.jp2
e0d9976a8e47a88ab95caeec9e435103
30dd50b3cbcfb3f6aadce572f020d5cc9e6d9227
F20101202_AAAPHV inglese_m_Page_053.jp2
20100fff7e438eafb60358eb73c03b8b
0d01367f757c4e27e984260c63529129c5c37b83
F20101202_AAAPIK inglese_m_Page_073.tif
5702c4ed3df3f424dd448935d24aa872
cdb3ddcba266ccb42863d326e4aacecfd122505a
F20101202_AAAPHW inglese_m_Page_049.tif
35dc360388eaac83e6d5f201e00e5f99
1076c6a6fdeb2153aa96b2b166c39c150b576046
F20101202_AAAPJA inglese_m_Page_015.jp2
4fc50bfc3bb2c550d8a0ff4520779a07
a9fcc77581ec508ce94a3a736fac2e8d9198b8be
77743 F20101202_AAAPIL inglese_m_Page_070.jpg
74fb75a451efb2fb7c5649101af581b2
6f018ba264d9c681f3acf97ef1e8669c5c111d73
29642 F20101202_AAAPHX inglese_m_Page_131.QC.jpg
c0654647b1281d4b01b0671049842964
de8b2975ae0192ba0b4220cb0eba3e33b8e7442b
7590 F20101202_AAAPIM inglese_m_Page_015thm.jpg
36a3e5251907c960da1d9d37db9919c5
696fc39cd637b13ae06b58ee386b6c80235f728a
97969 F20101202_AAAPHY inglese_m_Page_130.jpg
782ab162c4ca73ee6452bc4fde87c458
921904ff2516379d780bdd16cc23ac0e75e7fe90
28404 F20101202_AAAPJB inglese_m_Page_056.QC.jpg
e98b56bf43e6bebad6ceee9687920a92
e7b189bac1abcfc12bf0888b0f834208c82b77a3
1051953 F20101202_AAAPIN inglese_m_Page_084.jp2
a2e309bf01bc177cc9945e68d5bb643f
4a27a079f8a37e4cacef36fdeb4d75a7a04dc0e6
F20101202_AAAPHZ inglese_m_Page_097.jp2
a44455dff5299d7e58af8eb02cef31aa
28282bd3739dd62684f517eefed986ca98836539
F20101202_AAAPJC inglese_m_Page_102.tif
e2d9e14191569d01897f547a85a02856
1c5277bc7a1479c96bd7654476d0cea97ccc6949
7961 F20101202_AAAPIO inglese_m_Page_001.QC.jpg
f814a2775fca419e1c6f55afa95aa765
c3cdb3b35e39efc7452a29248fba811308eecca4
86615 F20101202_AAAPJD inglese_m_Page_048.jpg
1dc24b734fe1373b5c8c1574891b83db
deeac52f44a831b75b99179db0f51b496ee5a814
85221 F20101202_AAAPIP inglese_m_Page_105.jpg
68b31b2bafb74b720b3f48b08d123e6f
d4f3854eb048e07c46c57fdf4d2b20900c852397
7288 F20101202_AAAPJE inglese_m_Page_016thm.jpg
0678ec0eae04fec27221f8ae06bacf43
71b1fded56c9dbd57bfc29a0530e3c51d9898a29
1051928 F20101202_AAAPIQ inglese_m_Page_115.jp2
6ca58419e0999ad591e2c05d4b76aa51
5f52b9f542e70fc91dcc1cb8c0a393c8de4d68c6
F20101202_AAAPJF inglese_m_Page_050.tif
1ef78ef7c50f074be1b1fb03321e6cbf
7d8352329d681119ecaa2b3fffd1a9bf5247f180
25378 F20101202_AAAPIR inglese_m_Page_063.QC.jpg
aa0c7eaa1b0177b1ff70a39ee19eb92f
5d399b65600b39a1831ec4f9eed9f82f5aaa33be
F20101202_AAAPJG inglese_m_Page_089.tif
b023abbfd92e797fc098fb2adb469a4d
9347c49901f8e963e3620370db803f4e457664c2
7921 F20101202_AAAPIS inglese_m_Page_093.QC.jpg
ce3c713cac39899d7c48a5fdd7f755ef
fd54864af369d13266974faffe8054bbcb22b9f2
F20101202_AAAPJH inglese_m_Page_013.tif
b9b7a02284c11baffea051261cf1df5d
77f80f8ee71b5a19f0fa5dd5a940c95d8ce71081
27627 F20101202_AAAPIT inglese_m_Page_043.QC.jpg
8fbbbb04cb21b653e5f19292082797cc
72d4dd3c86db0d47d90cb7fc486f562d8ab4d6ad
107409 F20101202_AAAPIU inglese_m_Page_133.jpg
b03d2ba0b463716df89c8f639d2bd456
a7a9a59f88a4729b69af4ae4665a674ef8ddc627
F20101202_AAAPJI inglese_m_Page_092.tif
5f47de40f9bf1f1c0a33fde35270e719
6aa9d3da4e83cb9233d788412060ce56d2a4b181
26848 F20101202_AAAPIV inglese_m_Page_031.QC.jpg
2d2ff7b6f1eba7f3c0081c069114a023
31a7aa4d7397de4221c59ff374da3004e245b1f3
F20101202_AAAPJJ inglese_m_Page_040.jp2
4df2f29bfe597a3089ddabbad8585914
0a35b0f06135945f67113b14bb93ec316a6aa455
7406 F20101202_AAAPIW inglese_m_Page_115thm.jpg
05ebad14f808b082c2d1e220587b8528
fc1500a7c7e03039626391c2d01084eb0285db8d
850907 F20101202_AAAPJK inglese_m_Page_118.jp2
e608cc16a5861f32f56b2037a0c18b56
82af9437a9ae700859a77444ab0daf584cd5a52d
7276 F20101202_AAAPIX inglese_m_Page_097thm.jpg
f53d1309d58edbfed688c778061d2463
b712368c798f8cc0e0481dffc21c209ae9ba4837
F20101202_AAAPKA inglese_m_Page_021.jp2
0179ff012c9b20d185fab9e08548e9b4
d752fdc43adda3c97d3c0fa0f20716964bb536b2
1051922 F20101202_AAAPJL inglese_m_Page_103.jp2
1545da581c60f75bddde038a43393755
9f57248e297323b68e4b9d3d440e9bfdee99f79b
528911 F20101202_AAAPIY inglese_m_Page_011.jp2
a7026512b9f63d2b60d7e0cd6aecd64d
a734c883348401fce33bd52932a0e6da3d108cf5
7382 F20101202_AAAPKB inglese_m_Page_126thm.jpg
43cbebe6a8629acb868918a5d7dc7ab1
3814447c5d17b20e6e6b9a0e3953e2fde1d85385
F20101202_AAAPJM inglese_m_Page_039.tif
3104026de9e926df24919b9bb829ebc9
9c43a25a6d3707e3ddd2493be4367e9292d1cd7d
F20101202_AAAPIZ inglese_m_Page_031.jp2
4d066400fb9c93f166a341053b6d7a98
6f40926582121d7d5f11d773ab1799c7d57940ee
F20101202_AAAPJN inglese_m_Page_100.jp2
44f2ef38ff40af3358f116b0b47712ef
e1956628eaf41b4251f26c4510782e83a27aea1e
F20101202_AAAPKC inglese_m_Page_066.jp2
f96437613ef98c7ced41d029f498ae9c
3f522f30761dbe689e1c16414c3141fd46f94893
1732 F20101202_AAAPJO inglese_m_Page_009thm.jpg
a52a8337e1eb80b7fce22d2d84175bdf
77524e4ffd279c46c9bba5977e1ed9b2f68f7f0d
27957 F20101202_AAAPKD inglese_m_Page_019.QC.jpg
8df4ef7a039ffae062af7f21e9800a97
fc450ad8c5920ffdb76632e7817b8934864ea1a8
26918 F20101202_AAAPJP inglese_m_Page_014.QC.jpg
f46b4a0ba81f83b098a5c6ff5b882fe3
97a04854c83cd67f5d3b2cbc82b808d49a97f163
3750 F20101202_AAAPKE inglese_m_Page_008thm.jpg
692d0e98e0caca8ea88ad77c15686216
0ddb6b4af2e38a9a727dd8f33a8570affc38906a
100723 F20101202_AAAPJQ inglese_m_Page_134.jpg
59be378d0180a33738a3c09588ce2c00
5324ad1df2eeba4043eff9791f753612a862a0fa
80750 F20101202_AAAPKF inglese_m_Page_081.jpg
7f8d3f2841930b2b47859545a5e8ec76
93cbdfe9b1584e2562d719e9742136be097e69a4
30004 F20101202_AAAPJR inglese_m_Page_137.QC.jpg
b9212d49f992111f9baa0aa03dbb50b9
2116988f17820a1c1e5e42566d67e1593191c8ed
65266 F20101202_AAAPKG inglese_m_Page_139.jpg
d3111643b2b97e7e773923eb634d461c
a2efdb55fe44fbaa6a7bf36bb939ee85a0ec0ae5
2900 F20101202_AAAPJS inglese_m_Page_089thm.jpg
29ecc6467aa8a75da8e74683b1236179
c2557e63019188a6dcdff1f2309dfd567011ddfe
F20101202_AAAPKH inglese_m_Page_074.tif
fa76f0ce7fbfde6e7dbbfb21e4aaef76
be2be9150662dd56403a36ce068b9da8539f868b
27598 F20101202_AAAPJT inglese_m_Page_100.QC.jpg
d9a2866a5e7b6a2fbb2a68b4090ed8ae
9fe0f0512014920a3c000984d1ff815f75cc2513
113044 F20101202_AAAPKI inglese_m_Page_135.jpg
b1c8dc3455e6acabbe1e3ac74966092f
49b4ecacd0311ac2f7d3d9557067fc2e6500a7e6
93515 F20101202_AAAPJU inglese_m_Page_125.jp2
bb9b12403fbd819b31c13d0d6dd1cdad
78a2f1154be4716dd378499b79af7ee2e4c6ff6a
27816 F20101202_AAAPKJ inglese_m_Page_051.QC.jpg
9952cffe0d2b908593ed89db3c8f91bb
bc49361771e722e3ba79f0cacb66912f6f8d7e9e
F20101202_AAAPJV inglese_m_Page_128.jp2
e5ee7835aa9c2ebb6372afb364842405
ae40099480a4df278d9bc84ddf6b22f327a3231e
F20101202_AAAPKK inglese_m_Page_126.tif
52d3d638ddd1b51675208ba2ef62b379
7177ac9796bec27882b11d0e50135f06fd2784aa
7364 F20101202_AAAPJW inglese_m_Page_105thm.jpg
0f41f866288a22412d9221b996968252
f68e66ea25cadbc785f93084375455f90106a16e
7616 F20101202_AAAPLA inglese_m_Page_052thm.jpg
7c0007a627340b6ec87f060256244f95
31fa11d0c7f4db8649d1f968ce41d1ad41fdbd9b
2591 F20101202_AAAPKL inglese_m_Page_090thm.jpg
9433ce526d7714b65e33b979983f199d
20a3cdeafbabbc8a0f1f18c2eaab9f8c8de66c28
28998 F20101202_AAAPJX inglese_m_Page_015.QC.jpg
e30ad9a4fa6dd092203a6d481f89da2b
e37966387e0c6f66ac5191d71d8af849762701b9
88042 F20101202_AAAPLB inglese_m_Page_005.jpg
5cf401b5908b89b369632b1cdcb3da6e
10142b32f6e69be289bca8882e813da54eb843f7
27524 F20101202_AAAPKM inglese_m_Page_001.jpg
7ebaadf5b326f15c82e98077a5fab588
93401020f3d8f10324c331a1bb4b3c53ed081207
21974 F20101202_AAAPJY inglese_m_Page_010.QC.jpg
114ebea3837194f19a419b02d2abb413
7c29b1d314a7085ee3801222c09b2f8b2d9fb4d1
F20101202_AAAPLC inglese_m_Page_020.tif
3e6aa5c3ac7015a69f9184316004cbdd
5e130f614a34546d946e2b379f26faf8dc654e9e
F20101202_AAAPKN inglese_m_Page_067thm.jpg
df28c9aed42f65f93bfa7161a1d9ac4e
fbb9bc18dd8675c90ef4e4c00e065867a20a0e07
81677 F20101202_AAAPJZ inglese_m_Page_067.jpg
51f272d4569cf9009e771f6704b0ead6
1c49951550a7cb00dc10c921dade68d5604aef8f
7571 F20101202_AAAPKO inglese_m_Page_082thm.jpg
3805249850a450bbbe2737336d337061
db478569b472994199c6d5cbee529570201fd892
F20101202_AAAPLD inglese_m_Page_032.tif
f2b866e16fcb303aeef12c5120f4a133
064c07cf40923519a7b71c904879ac06355747ba
F20101202_AAAPKP inglese_m_Page_015.tif
5ed86768176caa0707a80e52815a90de
df73e63b193d1b8c2a19af5b1ef28c57a61a28c4
13262 F20101202_AAAPLE inglese_m_Page_088.QC.jpg
be99997ca97b254e899aa16be8ff6f23
e30b968d020a9c1ceab4fefc22a1270a4834bbe4
7287 F20101202_AAAPKQ inglese_m_Page_069thm.jpg
7f7fe40c21b96668e4ed987ccb0d89bc
48fd320b66db160d425fca6efa9ae5117353d1b1
26155 F20101202_AAAPLF inglese_m_Page_075.QC.jpg
7e0496b155db16c553db342425e892ba
86a918eaaebfd581b1b3f9c22a8a5896925969fc
F20101202_AAAPKR inglese_m_Page_018.jp2
9c230b3a5461f6a7aca98aa640d65587
2418c6908ba3e4a360997857165ff94ba83e22b0
F20101202_AAAPLG inglese_m_Page_036.jp2
90de8dc565ee3d10d030368dd3286294
9532ceead5c1d15693c5e854865866d2436915ae
F20101202_AAAPKS inglese_m_Page_020.jp2
4b2ef3fc9bd01c2b8aa736f15dea6dee
4e4aed8c51a5620dd02a92e818a72c4f5533b76f
659233 F20101202_AAAPLH inglese_m_Page_124.jp2
f4146cb036234cda742495f84776c1e3
87540cde919e77d4009aafaa91debba03d04cf64
F20101202_AAAPKT inglese_m_Page_021.tif
c6072d3cd7d73e3d708b9e35b4e9db37
22cbbad6babacdaa606545e37ef0c872c4c40d4b
F20101202_AAAPLI inglese_m_Page_054.jp2
b2a16db2f01209002272ef85d6866119
84b5e44aaae50cbd4173c0fe6edeb4136a45479a
86407 F20101202_AAAPKU inglese_m_Page_109.jpg
d38593ef6fb58e37dceab73113786de6
8252670d6932bde6582e0777a6b3a6b9bbbe2044
25790 F20101202_AAAPLJ inglese_m_Page_049.QC.jpg
6e7899e8272309a49ffd7ef70961dbc4
cc120901a9c030d6d43c5eef7d1d434f149f45c6
F20101202_AAAPKV inglese_m_Page_099.tif
49c6675cd2ef825d2a0d1fda935bc3dd
9273e6bb5e4306e942c591d3d8022a16ecb31e2d
F20101202_AAAPLK inglese_m_Page_047.tif
2c8481e55e8a969c888532d10309cdba
b0abe33f3ee879e1692e158de54513f4e11c0ac4
F20101202_AAAPKW inglese_m_Page_002.tif
ec14088409f7ec27249e7ec8ce995212
a7bd030d4b00f227e212199b77e2653abed84b0a
87261 F20101202_AAAPLL inglese_m_Page_034.jpg
f54882f0ad73d352fb3ceb6bf2ab9084
6bb32d6989b77edb3e6ae1b80e82dead6095f0f6
84748 F20101202_AAAPKX inglese_m_Page_038.jpg
0cd7f242ce8c462410f15f3526f7ab4e
7a537f492474850dadac29a9b0c71acd53e4c7c1
F20101202_AAAPMA inglese_m_Page_031.tif
7f771f336d404f71541ed7d3995126d7
832c6c857f587e28ef22895fc190199aafdd008f
20924 F20101202_AAAPLM inglese_m_Page_138.QC.jpg
d6e57c5764c40b85d1305a5fc0327a17
1f4279e5d1b7f8eb5cd76c31aa221c729e4a823c
2445 F20101202_AAAPKY inglese_m_Page_001thm.jpg
7c67b39995cf1155628d95824c2435ab
bcdd6a97d56032fd0a62ad373cec0b0a55c6ef31
F20101202_AAAPMB inglese_m_Page_120.tif
7c8613270e9323c251776b3dadfbc0c0
7f71d3a0752f5a1b6bc2ba132b2bc2d4616dfef8
2524 F20101202_AAAPLN inglese_m_Page_085thm.jpg
a0a8378ebbe2a2b41941106fcf8af40c
c0677703e5d2b461e011d76cde78bfc789f02b6d
6936 F20101202_AAAPKZ inglese_m_Page_084thm.jpg
400abf395defa90ca9d4f0371ef73f42
ee7465578ccf396ebc3a66b5c103ac4136290ed4
23774 F20101202_AAAPMC inglese_m_Page_085.jpg
5f3a7c5e6bea11e4e742b4955e7ae45d
b4ce48c2584443760ab04bdb528814d2b244e7cf
85492 F20101202_AAAPLO inglese_m_Page_127.jpg
ca04b6d7e68e5598504018c6f2741121
ac9b2ab3dc13c7d3bc3e8f24d6b3920daf0678e3
27818 F20101202_AAAPMD inglese_m_Page_095.QC.jpg
6e3cca8f9d0a37adf81fb4adbdf73bd6
d9f6fcdf1ebcb54b18fce04a5a64ae64ee88c785
F20101202_AAAPLP inglese_m_Page_037.jp2
9027d278d629f62b0510a6fb31e55784
0975c3b12c413344d6520375ca4826782013067d
44616 F20101202_AAAPLQ inglese_m_Page_119.jpg
43bb7e254ea1564bb4adc5296fc65288
1d75455e59c90a66bf24d2095bb13e897902601a
7503 F20101202_AAAPME inglese_m_Page_096thm.jpg
d89984a86e0c3d235c9e1d31bb083b7e
e0024b6c84473429ed0caef7650347d7775fefc6
85709 F20101202_AAAPLR inglese_m_Page_026.jpg
cc523ebaa65fa66bf7e24ac6cc491790
03f8a732db18526a544ee990808c41ce9127e1cd
84788 F20101202_AAAPMF inglese_m_Page_121.jpg
25d78acc41ad49ebe581f384d66695aa
4404c1c4ce5506da28a79c1d0d9ef491ae9395cb
7206 F20101202_AAAPLS inglese_m_Page_036thm.jpg
89f3e506208c3bfc4ac47a93c46bd139
bd7f7d061b2f326adc2023f121039b389ca375bb
F20101202_AAAPMG inglese_m_Page_113.jp2
a5a883f13c22fb3def72298c052855d5
a6511932cfbd32c194cac661809ab6aa81375f78
5111 F20101202_AAAPLT inglese_m_Page_124thm.jpg
a9a89105ea86fed2fa082e3accdc3c3e
d3f31193937ee52efcf645547dce648add92a8ce
7129 F20101202_AAAPMH inglese_m_Page_028thm.jpg
697f4a639948c03c762e14b7cbbe10fa
be6393fecab267bb6ac9fa6a794561dd80389ca3
31898 F20101202_AAAPLU inglese_m_Page_023.jpg
ce0e21ad957d78b4444ae93340a15c83
2548ba824a952d6ab59ee7dfdffa2eab5bcff12a
F20101202_AAAPMI inglese_m_Page_128.tif
0a947e4362115310340e0729622f419e
b7f472fb65e7944e8c0f6d156434c266bfaf4555
7400 F20101202_AAAPLV inglese_m_Page_040thm.jpg
27448acb180591197572cc45aac722af
2d204345c8e73b0baa0eb9fdfc59b28c8b0e83fa
6995 F20101202_AAAPMJ inglese_m_Page_022thm.jpg
acdf1a4d7dd2bbc023888836a40da13d
56834c4c38324d181d629ea1dfea3cedf90980b3
28811 F20101202_AAAPLW inglese_m_Page_018.QC.jpg
9ba0a56d5471e87c5a454c2930b123e1
ed2e9b597f0363bc78cd524b56e1247d805b5183
6573 F20101202_AAAPMK inglese_m_Page_079thm.jpg
3cfa25d293c8d727e951f311c725d229
af906d22af110efbeae800ab62be8ccc57286207
13203 F20101202_AAAPLX inglese_m_Page_116.QC.jpg
5f02313366b163c95d6f34c18f52ae66
7890eb4f1f481fa9472869b191984fb6605a49f4
F20101202_AAAPNA inglese_m_Page_041.tif
1a624b35a8716c56ac87fb1a3eff934c
2811fb1aa4c02ece384b9e7e273ac9fbdb483d79
F20101202_AAAPML inglese_m_Page_063.jp2
054c270bd5709efb669b854fadfe5a19
852244e7e65c6d7b737eabbb46b627ba503286f4
26907 F20101202_AAAPLY inglese_m_Page_128.QC.jpg
9bbafaf88014ff2f9cd394e64e7e12f2
9b273a9d43dec256676e1d0c03ff3b85d4eb019b
1051816 F20101202_AAAPNB inglese_m_Page_122.jp2
fd243256b698a70e82c20f563060f783
9ac69c580f74a586f1c0e52be9983b2d928758d5
7450 F20101202_AAAPMM inglese_m_Page_019thm.jpg
85bbd468417aa5239f27962ae2953651
b0ba53d68d86516870a41df323d5693c8520e76a
F20101202_AAAPLZ inglese_m_Page_101.tif
372c211d675c32d9f8a39b1ec09a6c26
f413ba0c71209c558533df89d6e8e6ed0e759019
81777 F20101202_AAAPNC inglese_m_Page_113.jpg
f0361c7a8402858dc48657932009c6cb
13e422168f4eaf2f7fbd075301fc7966c47ff899
F20101202_AAAPMN inglese_m_Page_094.jp2
1c97ba6244b2806874f3484b4b626349
cf86bb285299536949bc3f3b21ed363a96eb4d60
F20101202_AAAPND inglese_m_Page_136.jp2
9ba2117547eed2996321cffb23862c04
3368a2f1dc57a989677e676adb39f0602a10ee7b
77728 F20101202_AAAPMO inglese_m_Page_079.jpg
9c92db1289728ce1c4594986b5505956
b72bfb8e285dd7fb1f9d83978246aadbccfb172c
7456 F20101202_AAAPNE inglese_m_Page_060thm.jpg
3dea19e2b7f7a336d911106f178b1e4a
ecf203ce78baafd15396ea35347d8b7bb442c755
85994 F20101202_AAAPMP inglese_m_Page_060.jpg
094ebf7dd404f81cf2c2f2cd7f4a0d48
3e92780985c48fadeb8adc77a75ee5e0cb7e8549
27465 F20101202_AAAPMQ inglese_m_Page_058.QC.jpg
77ac40b3241eb9f271ac7bc425bf98c1
b0340f7f9c50946a749e30a8ccfbc983d8fa9830
74403 F20101202_AAAPNF inglese_m_Page_077.jpg
8a3b0012dd0e3ee7cb5b7ec8ebd21779
0c0c257e7eb86801a597cdced7e8f818972324a1
F20101202_AAAPMR inglese_m_Page_075.tif
39a9c6604a2f7b419ce494267b1fb85a
a1240aa0551f4804151a470ffc10a0179cedf3db
9300 F20101202_AAAPNG inglese_m_Page_023.QC.jpg
3b5db58f4a705bbe4a2ef854f91b7eda
c283014b9ab5cebf6a13bfa4c21c5ddf5631a316
81943 F20101202_AAAPMS inglese_m_Page_073.jpg
ab67204e0bfc6bc023ca5bca4984577a
80a953f0d161e425c5d98ee434b967c7bc6810a8
F20101202_AAAPNH inglese_m_Page_098.jp2
6c80c1ce53a8bd64ac2b6b9a56689c32
3f7542a222ed3ddf972844b36f9bd57870d1fd00
87188 F20101202_AAAPMT inglese_m_Page_103.jpg
a21c17a0a5f8dbcb2380e0ee18a20fed
62309e369b79d5342df2acf8c7ddcd5f2280e815
83946 F20101202_AAAPNI inglese_m_Page_016.jpg
c59e86767395fb75e955e296cc82b3cd
bee4a4fdd222162059601a8363369cf8ba92db93
6266 F20101202_AAAPMU inglese_m_Page_010thm.jpg
c63def20d1943954b2a6b021047c962e
4fb61d80d3f216bbb0551224d379c5801e245947
25281 F20101202_AAAPNJ inglese_m_Page_004.QC.jpg
545efbd0663160c6893353daf6372a9c
b76a86e880b5a28ed89b78454bf59371304796f2
81120 F20101202_AAAPMV inglese_m_Page_080.jpg
473bf28483d3e7578789c902ede689f3
eeffeb81c666785a5ae765e97cfb51fb6cda801e
84467 F20101202_AAAPNK inglese_m_Page_037.jpg
06b6239a0a38d65fbf5d1c3297e6cbc4
71a1fc77159f1a2071e497f24c14a8dd34a57840
85866 F20101202_AAAPMW inglese_m_Page_032.jpg
0ee2396d2481acb7532250d3fa8cd77d
45b1ddfbc83271e8b5b931ae6ad2a21ab2118df4
85465 F20101202_AAAPOA inglese_m_Page_031.jpg
bcd8ea3b6d9334244f0cec321f2d351a
643e6c9fb7066ba0ba9b201cbc824801a9b24692
F20101202_AAAPNL inglese_m_Page_112.jp2
ecf6dba0a6297ac2a32d6dab7b20fa21
7112de2a6c7b844fd56fc5814a3dfda84e041955
87555 F20101202_AAAPMX inglese_m_Page_095.jpg
1a76b12480bdf3aca555f943b10bacd6
4c014a7da52e001b580796a2cc753b075c51205e
84601 F20101202_AAAPOB inglese_m_Page_033.jpg
7696587a18048f34b38bc5163a011a49
3b0cf63131d1c3d30a79be4105181afbcce9e763
F20101202_AAAPNM inglese_m_Page_105.tif
bc69f356f2295eec70d98b5ddb963bc1
b386877c4605d6bdf84e07ae51006d6ec2554f72
6948 F20101202_AAAPMY inglese_m_Page_113thm.jpg
c4428462a18451957d72a1868817249d
3b5158a5387380b2d918d001edf8b42db85b260f
88086 F20101202_AAAPOC inglese_m_Page_043.jpg
30f14a627d7cb19d1230d1694d0dc050
07a67b0acf02bcba472baa12a7b408dcfbda5b79
103718 F20101202_AAAPNN UFE0022440_00001.mets
a29b349159db19c1ffcb34b0abe0535d
eaf662a9d68c202c4fdce91dea07c6dc0ac2bfe1
F20101202_AAAPMZ inglese_m_Page_108.tif
a7693e1fd220a7588c880834d132235a
508af133cc455079f79efbf729834e343b8036f2
83495 F20101202_AAAPOD inglese_m_Page_044.jpg
31bf244f0ffa5178e60827aff06f705b
bb010cb5fbd79948209a129134e9436ad0e03792
86541 F20101202_AAAPOE inglese_m_Page_045.jpg
c7f748f102f3d84fa08a03b99b814f7a
203232fead466339706d8e696fe6d15c9e3946e6
F20101202_AAAPOF inglese_m_Page_046.jpg
42724bc9d406e912271f09365381ab49
81b85d851f83ae9a62947ec64976f2deba6d3f74
73325 F20101202_AAAPNQ inglese_m_Page_007.jpg
66b9e8d7119aa3434e272dc93457e0a9
012b411102d751ba036317f31c3d80d0fdbb4ce4
45974 F20101202_AAAPNR inglese_m_Page_008.jpg
8f317c776663ecba2db1351aeef6b2fb
1fd3fd95f61f70deb78e876609e8a93d713e7167
13097 F20101202_AAAPNS inglese_m_Page_009.jpg
8be22d5dfa60e1a3a095defbc68566ea
9a851f68d8f9b76d00609309b7c8d2248a5ccce3
81886 F20101202_AAAPOG inglese_m_Page_049.jpg
7bfdc8f7f9de15a277ecfc29d4ceb241
64fdc82bc50e23e3224a6ef632cb710c0f935adb
86485 F20101202_AAAPNT inglese_m_Page_012.jpg
7bae3648734a2f725be47b3ae62e855c
2b9a5e7c9250deab8400cd402aba910cd3648465
89706 F20101202_AAAPOH inglese_m_Page_056.jpg
0b2beabb38a5fc81196d3e4a29ec2a72
e6c32afa92a98789f089898e95baf4dda6b66e35
90401 F20101202_AAAPNU inglese_m_Page_013.jpg
86566fc619dde8e0c24d2b4f08b533d9
c276908b60f75a575a06fff1a1dd08b79e97630e
90557 F20101202_AAAPOI inglese_m_Page_057.jpg
cccb3f74532823001d617974b77491c6
2fbe0839b81b1c2162272715b59a546434c59a28
83913 F20101202_AAAPNV inglese_m_Page_014.jpg
1b2b8ec47a17a2ffaaeda12f8f975d5b
a0d947d647e9049821d7b7f546f6b09162009fa9
87659 F20101202_AAAPOJ inglese_m_Page_058.jpg
c098163ce1da7d47e623d4229609ad7a
23be149844c142334d1a3699f2c16dfda15f9b3f
31870 F20101202_AAAPNW inglese_m_Page_024.jpg
74073aaf79b55e0c6e8c464fd3e573f1
e1ed027d28c4fe355750b333ab6465979c80bd35
87578 F20101202_AAAPOK inglese_m_Page_062.jpg
d7bc66aaf374cf6898fd95e6f56f8fe2
a6ee329ca9f10f4294e138ddf2db1a8ff2908e79
84499 F20101202_AAAPNX inglese_m_Page_025.jpg
f9a42634e98e29aca2aa6f9ed2fc3b17
40de18b96f1febcef662513519d424c4b19c04e6
81513 F20101202_AAAPPA inglese_m_Page_104.jpg
750a5292dd017891e5b8100d2e148c60
734535d8cebe8c164818f02743880ce196ff5680
F20101202_AAAPOL inglese_m_Page_064.jpg
b4e39b7f5c76a6a8273b779144d4a19b
45ec957387d9c5882ff490730184ce30f3f29cc9
89313 F20101202_AAAPNY inglese_m_Page_027.jpg
b6c4af717bbe9f8da3fa20edcc464835
c345992603c41728d8eb1622161eeae42436eea3
85524 F20101202_AAAPPB inglese_m_Page_106.jpg
a5adf733c9ad2f6f3c429a771c06c8b8
3283e73a1c83370d0c06d1d9ba7aab3acb724365
82540 F20101202_AAAPOM inglese_m_Page_066.jpg
cbab0d50d68546da9b1e9113d738faba
7ca9a4f4738d6beb2f408b4ff22cf20150a4daec
85753 F20101202_AAAPNZ inglese_m_Page_028.jpg
7e81e2a2a550556fc4518749a246ed9e
f0d0bceac9051175edf946e1c029144c54e06907
90075 F20101202_AAAPPC inglese_m_Page_108.jpg
3175d2cb217e587f670f864221a5ba65
ebac895c54c7b4e4a1fa620fe9bce92bdf1e50e8
77691 F20101202_AAAPON inglese_m_Page_068.jpg
d65fcadd3ff39f8d8fb070c0878abaf8
f07ce50cf18a2dbee29aae03bf21fca372d36299
83190 F20101202_AAAPPD inglese_m_Page_110.jpg
c8902515643fee8f900d4e43dfad27ef
ff81f1ba836e942194f1225fb78fd83b19dd4f5a
73591 F20101202_AAAPOO inglese_m_Page_071.jpg
78f3ccb9966c00ed50cf92918dc9cfc4
8f8df417122ceb2ca29bf6b23821e21a405ebb90
86446 F20101202_AAAPPE inglese_m_Page_111.jpg
1b57ed3350879a940d0992943904df3d
88e58b37fb57df6fa55c98c0b5ebd351f342f2e0
81935 F20101202_AAAPOP inglese_m_Page_076.jpg
e48acce04f1ba8d2e2f5f7f07e05308e
2b9db1cfefe97147d1d5d4b9cda6767f007a5876



PAGE 1

1 PAIN EXPRESSION IN CHILDREN WITH AUTISM SPECTRUM DISORDER (ASD): A FOUNDATION FOR INSTRUMENT DEVELOPMENT By MELISSA DODD INGLESE A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLOR IDA IN PARTIAL FULFULLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNIVERSITY OF FLORIDA 2008

PAGE 2

2 2008 Melissa Dodd Inglese

PAGE 3

3 To my parents, for their consta nt love and encouragement, and for instilling in me the importance of higher education; To my sister, who has the most generous heart, and teaches me how to live and love life; To my brother, whose own academic excellence challenges me daily, and inspired me to persevere these past years; And to my husband, for his unconditional love, and for steadfastly pointing me towards Christ when I need strength

PAGE 4

4 ACKNOWLEDGMENTS I would lik e to express my sincere appreciation to my chair and mentor, Dr. Jennifer Elder, for her assiduous encouragement and support throughout this process. Her constant availability, guidance and insight allowed me to successfully navigate the complex world of research. I would also like to gratefully acknowledge Dr. Jo Snider, who saw potential in me before I realized it in myself, Dr. Ann Horgas, who provided me with an early opportunity to tangibly experience research, and Dr. Sheila Eyberg, w ho remained patient and always encouraging throughout this process. I wish to especially thank the many caregivers that participated in these studies. Their willingness to share valuable thoughts and descri be personal experiences enabled me to shed light on such an important issue for these childr en and families. Add itionally, I would like to specifically thank the autism researchers and c linicians who took time to offer their expert opinions in the second stage of this research. Th eir collective wisdom help ed me gain a better understanding of how to better se rve this population of children. Furthermore, this list would not be comp lete without acknowledging my own family. I imagine they wondered several times whenor ifthis day would come. Without their enthusiasm and belief in my ab ility to complete this research, I might have given up long ago. Thank you. I would like to thank my precious husband, who met, dated, and married me in the midst of this academic pursuit. He has never known me as anything but a doctoral student. You are my rock, friend, encourager, confidant, a nd the source of so mu ch joy in my life. Finally, I acknowledge my Lord and Savior, w ho daily enables me to see the world with compassion. His love for me drives the work I do and is the reason I desire to dedicate my life to serving others, as a nurs e, educator, and researcher.

PAGE 5

5 TABLE OF CONTENTS page ACKNOWLEDGMENTS...............................................................................................................4 LIST OF TABLES................................................................................................................. ..........8 LIST OF FIGURES.........................................................................................................................9 ABSTRACT...................................................................................................................................10 CHAP TER 1 INTRODUCTION..................................................................................................................12 Background and Significance of the Problem........................................................................ 13 Rationale and Need for This Work......................................................................................... 15 Theoretical Framework and Nursing Metaparadigm.............................................................. 17 The Development of Pain Theory................................................................................... 17 The Communications Model of Pain............................................................................... 18 Kings Interacting Systems Fram ework: Nursing Metaparadigm ...................................21 Dissertation Purpose........................................................................................................... ....22 Research Questions............................................................................................................. ....22 2 REVIEW OF THE LITERATURE........................................................................................ 25 Autism Spectrum Disorder (ASD).......................................................................................... 25 Prevalence........................................................................................................................26 Review of Possible Etiologies for ASD.......................................................................... 27 Genetic predisposition..............................................................................................28 Environmental influences......................................................................................... 29 Vaccines...................................................................................................................30 Psychological perspectives.......................................................................................30 Core Features Exhibited by Children with ASD............................................................. 37 Autism......................................................................................................................38 Aspergers disorder (AD)......................................................................................... 39 Pervasive developmental disorder-not otherwise specified (PDD-NOS)................ 41 Communication Impairment in ASD...................................................................................... 41 Overview of Communication Theory..............................................................................43 Language and Communication........................................................................................44 Language Development................................................................................................... 46 Innateness.................................................................................................................46 Developmental changes............................................................................................ 47 Processes..................................................................................................................47 Critical periods and continuity................................................................................. 48 Communication Impairment and Its Influence on Pain Expression in AS D...................50 Pain Assessment in Children.................................................................................................. 52

PAGE 6

6 Pain Assessment in Vulnerable Pediatric Populations........................................................... 54 Cerebral Palsy and Neurological Impairment................................................................. 55 Neonates at Risk for Ne urological Impairm ent............................................................... 56 Children with Cognitive Impairment............................................................................... 57 Non-Communicating Children w ith Cognitive Impairm ent............................................ 58 Ethical Considerations............................................................................................................63 Vulnerable Populations................................................................................................... 63 The Study of Pain............................................................................................................65 Rationale and Need for Instrument Development.................................................................. 66 Summary.................................................................................................................................66 3 METHODS AND PROCEDURES........................................................................................ 68 Instrument Development........................................................................................................ 68 Study 1: Caregiver Perspectives of the Pain Experience in ASD ........................................... 68 Purpose............................................................................................................................69 Study Design................................................................................................................... 69 Participants: Recruitment, Consent, and Anonymity...................................................... 69 Measures/Instruments...................................................................................................... 70 Caregiver Survey on pain expres sion in children with ASD ................................... 70 Semi-structured interview guide to discuss pain in ASD ......................................... 70 Data Synthesis and Analysis........................................................................................... 71 Study 2: Expert Appraisal of Potential Pain Expressive Indicators in ASD .......................... 71 Purpose............................................................................................................................71 Participants: Expert Reviewers........................................................................................72 Measures/Instruments: Item List for Expert Review ....................................................... 72 Procedures and Data Analysis......................................................................................... 73 Establishing content validity.................................................................................... 73 Item-level content valid ity indexes (I-CVI) .............................................................74 Scale-level content validity index............................................................................ 76 Expert comments and suggestions........................................................................... 77 Summary.................................................................................................................................77 4 RESULTS...............................................................................................................................79 Study 1: Caregiver Survey Results......................................................................................... 79 Demographic Information............................................................................................... 79 Quantitative Results from Caregiver Surveys.................................................................80 Descriptive Information Provided by Caregivers ............................................................ 80 Study 2: Expert-Rated Relevance of Potential P ain Indicators..............................................82 Examination of Item-Level Content Validity Indexes.................................................... 82 Calculation of a Scale-Leve l Content Validity Index ......................................................84 Expert Comments and Suggestions................................................................................. 84 Summary.................................................................................................................................84

PAGE 7

7 5 DISCUSSION.........................................................................................................................94 Pain Expression in ASD Compared to Typically Developing Children................................. 94 Determining When Children with ASD are in Pain............................................................... 96 Communication and Social Impairment s in ASD and Pain Expression .................................99 Items Determined to be Relevant to Pain Assessm ent in ASD............................................ 100 Primary Pain Indicators: Retained Items....................................................................... 101 Secondary Pain Indicators: Item Retention and Revision............................................. 103 Items Removed from the Item List Following Expert Review..................................... 106 Expert Comments and Suggestions............................................................................... 106 A Need for Individualized Pain Assessment in this Population....................................107 The Role of Direct Behavioral Obse rvation in Instrum ent Development..................... 108 Next Steps in this Instruments Development...............................................................109 Limitations.................................................................................................................... ........112 Survey Response Rate................................................................................................... 112 Quasi-Qualitative Design..............................................................................................113 Nursing Implications and Clinical Significance ................................................................... 114 Future Directions..................................................................................................................115 APPENDIX A STUDY 1: CAREGIVER SURVEY COVER LETTER EXPLAINING PARTICIPATION ................................................................................................................121 B STUDY 2: ITEM LIST FOR EXPERT REVIEW ............................................................... 122 C STUDY 2: ITEM LIST COVE R LE TTER EXPLAINING STUDY AND PARTICIPATION................................................................................................................126 LIST OF REFERENCES.............................................................................................................127 BIOGRAPHICAL SKETCH.......................................................................................................139

PAGE 8

8 LIST OF TABLES Table page 3-1 Study 1: Caregiver survey and se m i-structured interview questions.................................78 4-1 Study 1: Quantitative results from caregiver surveys........................................................ 86 4-2 Caregiver survey (questi on 1) resu lts: Identification a nd description of frequently reported themes..................................................................................................................87 4-3 Caregiver survey (question 1) results : Iden tified themes and sample caregiver quotations...........................................................................................................................88 4-4 Pain indicators identified by caregivers of child ren with ASD ......................................... 90 4-5 Study 2: Calculated item-level conten t validity in dexes (I -CVI)* for each item reviewed by experts........................................................................................................... 91 5-1 Comparison of expert-identified pain indica tors f or use in ASD with pain indicators from three existing pain assessment tools........................................................................ 117 5-2 Study 2: Variability in expert-rated rele vance am ongst all items with an I-CVI = .67... 120

PAGE 9

9 LIST OF FIGURES Figure page 1-1 The Communications Model of Pain................................................................................. 24

PAGE 10

10 Abstract of Dissertation Pres ented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy PAIN EXPRESSION IN CHIDLR EN WITH AUTISM SPECTRUM DISORDER (ASD): A FOUNDATION FOR INSTRUMENT DEVELOPMENT By Melissa Dodd Inglese August 2008 Chair: Jennifer Elder Major: Nursing Sciences Little is known about how children with autism spectrum disorder (ASD) experience and express pain. Communication im pairments frequently render children with ASD unable to reliably self-report pain, social impairments limit their understandi ng of interpersonal interaction (and possibly alter the social context surrounding the pa in experience), and pe rseverative and/or repetitive displays of behavior may influence th e pain indicators traditio nally associated with children who are physically hurting. Additionally reports of children with autism having a high tolerance for pain create confusion and generate misunderstandings regarding whether they are capable of feeling pain. The overall purpose of this research was to explore how children with ASD express pain, and determine whether it is feasible to devel op a pain assessment tool specifically for this population. In order to approach this global research question, a series of two studies were conducted to 1) explore caregiver beliefs about the pain experience in their children with ASD, 2) identify a number of potential pain indicators in this popula tion, and 3) determine which pain indicators are believed by expe rts to best indicate pain in children with ASD.

PAGE 11

11 Findings revealed that pain is a serious concern among caregivers. Parents struggle to determine when their children are in pain. St udy 1 results indicated that children with ASD are capable of experiencing and expressing pain, however their pain expression is unique. Study 2 validated this uniqueness by identifying pain in dicators specific to ch ildren with ASD, and by demonstrating that indicators rele vant to other, similar populations of children are not considered to be relevant in this population. This research supports the initial belief that a pain assessment tool specifically for use in ASD is warranted. Future research will build upon these studies to continue development of a valid and reliable instru ment to assess pain in individuals with ASD. Accurate pain assessment is necessary in order to ensure that pain in this population does not go unrecognized, and thus untreated.

PAGE 12

12 CHAPTER 1 INTRODUCTION In 1989, McCaffery and Beebe established what is now one of the m ost widely recognized definitions of pain. Their definition emphasizes the subjective nature of the pain experience, and proposes that pain is whatever the patient says it is and occurs whenever the patient says it does (p. 7). Given this well established definition, coupled with other nationally acknowledged definitions, the accepted gold standard for pain assessment and measurement is self-report. This measurement captures the subjective aspect s of the pain experience, and supports the prevailing belief that pain is a unique and individualized proce ss, heavily influenced by the perceptions of those experiencing it. This definition however, i nherently implies that the person experiencing pain can verbally communicate his or her subjective experi ence. The International Association for the Study of Pa in (IASP) defines pain as a s unpleasant sensory and emotional experience associated with actual or potential tissue damage, or described in terms of such damage (IASP, 2007, 17). This definition also emphasizes the subjective nature of pain, and supports the use of self-report, whic h solicits how an individual would describe his or her pain to others (Merskey, 1991). In 1996, Anand and Craig critiqued the most co mmonly cited pain definitions and stated that pain assessment must be designed to conform to the communicatio n capabilities of the suffering person (p. 3). They emph asized the responsibility of scientists and clinicians to adapt a working definition of pain that would incl ude certain vulnerable popul ations. Specifically, they referred to a) individuals unable to communicate verbally (i.e., infants, or perhaps children and adults with communication impairment), and b) individuals whose verbal self-report might be unreliable (i.e., younger children, and persons with cognitive impairment or dementia). Effective pain assessment and measurement in a variety of populati ons requires that one

PAGE 13

13 understand how to identify and interpret specific nonverbal indicators of pain, especially when verbal pain expression is confounded by an underlying condition (Oberlander & Craig, 2002). This research focused on one particular vulnerable populationone that poses an extremely unique challenge to pain assessmentchildren diagnosed with an autism spectrum disorder (ASD). Communication impairments fre quently render children with ASD unable to reliably self-report pain, social impairments limit their understandi ng of interpersonal interaction (and possibly alter the social context surrounding the pa in experience), and unusual (perseverative and/or repetitiv e) displays of behavior may influence the pain indicators traditionally associated with children who are physically hurting. Additionally reports of children with autism having a high toleran ce for pain create confusion and generate misunderstandings regarding whether they are capable of feeling pain. If individuals, specifically healthcare providers, assume that chil dren with ASD are not capable of feeling pain as a result of their underlying diso rder, these children are at treme ndous risk for having their pain go unrecognized and untreated. At present, it is unclear how ch ildren on the autism spectrum cognitively perceive, apply m eaning to, and commonly express their physical discomfort. Background and Significance of the Problem Prior to 1989, the pain experi en ce in children was severely underestimated, if even acknowledged at all. The prevailing belief was th at young children did not feel pain in the same way as adults (Finley & McGrath, 1998, p. 1). It was also believed that if they do feel pain, their inability to remember the painful event negates the need for astute pain management. The seminal work of Anand (1989) not only established that children, infants, and neonates have fully functioning nervous systems capable of pro cessing pain, but pointed out that inadequately treated pain can have detrimental and permanent physiological effects. Anand emphasized the primitive biological function of pain, which is to alarm the body that something is wrong and

PAGE 14

14 needs attention. Its presence from birth supports th e notion that pain is often vital to survival (Hadjistavropoulos, Craig, & Fuchs-Lacelle, 2004) These reports amended attitudes towards pediatric pain assessment and management. Rather than assume children do not feel pain unless overtly indicated, researchers and clinicians inve rted the paradigm to assume children always experience pain during procedures an d situations that would normally be painful to an adult. As previously pointed out however, assessing pain in children (especially infants, preverbal children, and noncommunicating an d/or cognitively impaired children) can be challenging, specifically when relying upon self-report. Duri ng the past several decades, emerging pediatric pain research has aimed to overcome several of these challenges. A number of tools are now available to assess pain in typically developing children, those capable and incapable of self-re port. Pediatric pain assessme nt tools generally rely on behavioral, physiologic, and/or f acial indicators to make infere nces about whether a child is hurting (Stevens, 1998). More recently developed instruments assess pain from a multidimensional perspective by including indi cators from each of the aforementioned categories. When self-report is available, it is solicited. If self-report is consistent with behavioral and physiologic indicators, the most comprehensive picture of a childs pain experience is obtained. For groups of children where self-report is unav ailable or unreliable, assessment tools must focus solely on behavioral, physiolo gic, and facial indicators of pain. Some of these children have traditionally been excluded from pain re searchsecondary to the challenges associated with assessing their painand include, for ex ample, children with cognitive impairment, noncommunicating children, children with cerebra l palsy, and children with other neuromuscular disorders that significantly limit their physical capabilities. Recent pain study initiatives have

PAGE 15

15 resulted in a slightly increased understanding of how some children with cognitive and motor impairments experience and express pain. Severa l researchers have begu n to describe pain expression in children with cognitive and neurological impairment, identifying through caregiver interviews and surveys those behaviors most indicative of pain (Br eau, McGrath, Camfield, Rosmus, & Finley, 2000; Gilbert-MacLeod, Craig, Rocha, & Mathias, 2000; McGrath, Rosmus, Canfield, Campbell, & Hennigar, 1998; St allard, Williams, Velleman, Lenton, & McGrath, 2002). To date however, there have been minima l attempts to comprehensively articulate how children on the autism spectrum experience and expre ss pain. This dissertation research adds to the growing body of knowledge re garding the pain experience in vulnerable subpopulations of children; specifically, it a dds to what is known about pain ex pression amongst the vastly diverse group of children who have been diagnosed with ASD. Rationale and Need for This Work The notable gaps in th e literature indicate th at while some work reflects an attempt to understand how nonverbal children and children w ith cognitive impairment communicate pain, the pain experience in children on the autism spectrum has hardly been explored. This is problematic because, as previously mentioned, th e reported high tolerance for pain in children with ASD leads many to assume they are incap able of feeling pain. Nader, Oberlander, Chambers, and Craig (2004) published what is pe rhaps the first and only empirical investigation examining pain expression in children with au tism. They reported that children with autism display a significant behavioral reaction in response to a painfu l stimulus, and these findings are in sharp contrast to the prevailing beliefs of pain insensitivity described in the literature to date (p. 88). Interestingly, th ey also highlighted the challenges parents encounter when assessing pain in their children with autism. Parents were aske d to report whether they believed their children were sensitive to everyday painful events at home. When parental reports were compared to the

PAGE 16

16 childs objective facial responses to an acute pain event, those children reacting most to the painful stimulus had been previously identified by their parents as having a high tolerance for pain. This discord led the authors to highlight the need for additional exploration into how caregivers perceive their childrens ability to feel pain. Additionally, they stated that research needs to identify the factors that might influence pain expression and parental report of pain in this population. What do caregiver s believe about whether their ch ildren can feel pain, and how do they assess pain in this population? Is it possible to develop a pain assessment tool specifically for use in this uni que group of individuals? Thes e were the foundational questions for this research. Streiner and Norman (1995) poi nt out in their in troduction to health measurement scales that most researchers tend to magnify the deficiencies of existing measures and underestimate the effort required to develop an adequate new m easure (p. 4). They subsequently state that perhaps the most common error committed by clini cal researchers is to dismiss existing scales too lightly, and embark on the de velopment of a new instrument with an unjustifiably optimistic and naive expectation that they can do better (p. 4). Despite the daunting and long-term nature of instrument development, a thorough review of the literature revealed that there is no existing psychometrically sound pain assessment tool ava ilable for use with children who have ASD. Relatively little is known about how this populati on experiences and expresses physical pain. An assessment tool that caregivers and health care professionals can use to determine when children with ASD are in pain is needed. This research established a foundation for futu re research into how children on the autism spectrum express pain. The follo wing discussion addresses seve ral identified gaps in the literature, and clarifies the di scordant messages circulating when it comes to whether these

PAGE 17

17 children feel pain. Caregiver pe rceptions regarding th e pain experience in children with ASD were explored in a first study, while insight from autism experts was obtained and examined in a second study. Understanding pain expression in children on the autism spectrum is important for healthcare providersespecially nurseswho often in teract directly with children and families, and function frequently as advocates and educators. Ultimately, this research is important because in gaining a better understanding of how children w ith ASD express pain, families of newly diagnosed children can be well-informed. This info rmation has the potential to alleviate suffering in an often silent and isolated population. Theoretical Framework and Nursing Metaparadigm Theoretical and concept ual models inform th e research process by providing an organized foundation from which relational questions and hypotheses may be derived. These questions and hypotheses may be descriptive and e xploratory in nature, or they may aim to test a prescribed intervention. While some theoretical models ar e more abstract (metaparadigms), and speak to the philosophical assumptions and/or worldview of a particular disc ipline, those theories utilized to guide research (middle-range theories) must pr ovide clear definitions for the central concepts, and articulate the multiple relationships be tween concepts (Alligood & Tomey, 2002; Peterson, 2004). Concepts need to be linked to empirical indicators in order to provide a means for directly measuring a particular concept and its po stulated relationship to other concepts (Fawcett, 2005). The research process aims to test these th eoretical relationships an d either support, or refute them. The Development of Pain Theory A num ber of theories can house a research program focused on the study of pain. Pain theory has evolved rapidly duri ng the past 40 years, ignited by the introducti on of a groundbreaking model by Melzack and Wall (1965), which delineated a multidimensional pain

PAGE 18

18 processing system for the first time. Their mode l also articulated the hypo thesized role of the brain (central processing) in pai n, and it is now realized that th e brain is a significant modulator in the pain experience. Most current pain theories emphasi ze the interplay between physiology, neurobiology, and psychology (cognition and emotion) in the perception and expression of pain. This research examined how children with ASD mi ght process, perceive and ultimately express pain to others. It focused primarily on determ ining how to identify whether a child with ASD is in pain. This inquiry needed to be theo retically guided by a mode l that addresses the relationships between concepts important to processing, perc eiving, expressing, observing, and measuring pain. Specifically, because of the impairments in social and communicative abilities common to children with ASD, a theory that accounts for how these capacities influence the perception and expression of pain is most appropriate for pain research in this population. The Communications Model of Pain Craig (1998) exam ined available pain models and concluded that cu rrent models ignored interpersonal processes whereby the pain experience is encoded in expressive behavior, which observers must decipher [italics added] in order to appreciate the s ubjective nature of pain (p. 104). He and others set forth to develop a m odel that would integrat e various aspects of communicating pain to others, and focused spec ifically on how observational strategies might allow a third party to decode pain behaviors in an individual who could not verbally self-report pain. The resulting Communications Model of Pain (CMOP; Hadjistavropoulos & Craig, 2002) was used to guide this research. Hadjistavropoulos and Craig (2002) depict the pain experien ce in an A -> B -> C model (Figure 1-1). The internal state (A, in figure 11) during a physically pain ful event is affected by intrapersonal and contextual influences. These influences include the affective and motivational components of pain, the biological nature of the brain and nervous system, and the cognitive

PAGE 19

19 capacity to apply meaning and perceive pain. The experience is encoded (B, in Figure 1-1) and expressed through various voluntar y and involuntary behaviors reflecting the interpersonal component of the model. The higher mental pr ocessing pathway encompa sses ones ability to voluntarily communicate his or her pain, or to perhaps even hide th e fact that one is in pain. This represents the shared experience of pain with others, particularly with an observer. Coupled with the voluntary pain expressive signals shared w ith others are various i nvoluntary (or reflexive) indicators of pain. Finally, everything an obs erver knows about the pain experience of another individual must come from the individual experi encing pain. This process of decoding (C, in Figure 1-1) someone elses e xperience depends heavily on the clarity of the messages coming from the verbal and nonverbal programs. Add itionally, individuals bri ng their own experiences and perceptions with them when they attempt to decode, or interpret, another persons pain expressive behaviors and/or reports. The CMOP is a comprehensive model, appropriate for this inquiry into how children with ASD might experience and express pain. Its emphasis on inferring pain from verbal and nonverbal indicators, and inclusi on of both voluntary and involuntary responses to pain, made this framework useful for the conducted research. Theoretical models allo w researchers to test specific relationships between concepts. This requires a formal definition of each concept, and a way to empirically measure concepts. In this particular research, it was not yet determined how children with ASD might encode pa in in expressive behaviors. And thus, because this research involved conducting exploratory desc riptive studies, empirical indi cators were not derived from the current model. Rather, this research aimed to determine what specific empirical indicators would be appropriate for each concept described by the model, given the population of interest. For example, in many children with ASD, communi cation is impaired, and thus children cannot

PAGE 20

20 verbally self-report pain. The CMOP emphasizes the importance of identifying and utilizing automatic processing and nonverbal indicators of pa in when self-report is not available. This research began to make it possible to attach specific empirical indicators (i.e., those items comprising a pain assessment tool for children with ASD) to the concept labeled nonverbal programs in the model. Other concepts explored in this research in clude observer bias, message clarity, and for those children with verbal ability, ver bal programs of pain expression. Caregiver perceptions regarding whether they believe their children can feel pain were solicited. These perceptions can now be examined in light of th is model, and the impact of how observer bias might influence a caregivers ability to decode pain expression in their children can be formally tested in future studies. Add itionally, message clarity was explor ed as caregivers described the challenges associated with asse ssing pain in their children. The CMOP is one of the first thorough attemp ts to emphasize that pain processing is not comprised solely of neural and sensory components. This model highlights not only the role of the individual experience, but al so the interpersonal experience. The model also allows one to consider how joint attention might influence the understanding and expression of pain in individuals. If children with ASD are capable of feeling physical pa in, their intrapersonal experience might be similar to a typical childs. It may never be possible to accurately depict how they perceive or apply meaning, because as a decoder, all information must be interpreted. Knowing, however, th at children with ASD have di fficulty jointly attending to a shared experience, one can postulate that atte nding to a painful even t might be impaired. Dawson et al. (2004) report that attention to the distress of ot hers is related to ones joint attentional skills. These findings indicate that th e social intersubjectivity of the pain experience

PAGE 21

21 likely plays a more important role than previously considered in earlier models of pain (Deyo, Prkachin, & Mercer, 2004). If intersubjectivity is impaired in individuals with ASD, their sharing of a painful experience is also subj ect to impairment. The CMOP offers a creative framework which also accommodates deficits in social interaction and allows researchers to begin to theorize how social impa irment might influence pain e xpressionwhich is critically important when considering the pain experience in children with ASD. Given the challenges associated with assessing pain in children with ASD, the CMOP accommodates those modes of pain expression (i nvoluntary and nonverbal indicators) that will likely need to be relied upon for accurate pain assessment in this population. As the exploratory, descriptive studies were conducted, findings were examined in light of how this model depicts the pain experience in individuals with communication and/or social impairments. Kings Interacting Systems Framework: Nursing Metaparadigm Parse (2000), a well known nursing theorist, em phasizes that m iddle-range theories are hypothetical statements that can be tested by quantitative re search through the operationalization of terms (p. 91). She purports that these groups of hypothetical statements are without meaning until they are framed with in a conceptual framework. Some nursing theorists, when addressing the advancement of nursing science, believe that middle-range theories may be borrowed from other discipline s only if they are linked to nursing conceptual frameworks and philosophy (Fawcett, 2005; Pars e 2000; Villarruel et al., 2001). Thus, the particular pain model guiding this research was linked to a more abstract nursing metaparadigm; specifically, to the one developed by Imogene King (1981). The general concepts and underlying worldview of the CM OP align nicely with the philosophical and conceptual development of Kings (1981) systems framework, which emphasizes interaction, and the communicative nature of human beings as they relate to others

PAGE 22

22 and their environment. Imogene Kings conceptu al model defines the major concepts pertinent to the discipline of nursing, such as those in the overall metaparadigm of nursing: human beings, environment, health, and nursing. She delineates her philosophy regarding how these abstract concepts relate to one another. Her conceptual framework derives from systems theory, and focuses on three specific interacting systems: pers onal systems, interpersonal systems, and social systems. The CMOP approaches pain from a framework that assumes individu als bring their entire being to a situation, and that they interact with others, conveyi ng communicative signals (i.e., in this study, expressing pain via verbal and nonverbal modalities) for interpretation by others. The CMOP emphasizes the importance of the environm ent, communication, and so cial factors in the experience, expression, and obser vation/interpretation of pain, both of which are described abstractly by King (1981). The metaparadigm developed by King reflects the overall nursing approach that was applied when conducting this research. The CMOP however, more specifically defines the concepts pertinent to this research, and will ultimately allow for specific testing of relationships between concepts. Dissertation Purpose The overall purpose of this research was to explore how children with ASD express pain, and determ ine whether it is feasible to devel op a pain assessment tool specifically for this population. In order to approach this global research question, a series of two studies were conducted to address several mo re specific questions. Research Questions Two exploratory descriptive studies addr essed the following research questions: 1. What do caregivers of children with autis m spectrum disorder (A SD) believe about the way their children experien ce and express pain?

PAGE 23

23 2. Do caregivers find it difficult to determine when their children with ASD are in pain? Further, if they can determine when their child is in pain, what specific indicators are utilized in pain assessment? 3. Do caregivers of children with ASD believe healthcare providers adequately assess and treat their childrens pain? 4. How do autism experts describe the nature of the pain experience in children with ASD? 5. What specific indicators do autism and pain e xperts believe are relevant to pain assessment in children with ASD? 6. Is it feasible to develop a pain assessment tool for us e in the ASD population?

PAGE 24

24 Figure 1-1. The Communications Model of Pain. (Hadjistavropoulos & Craig, 2002) A Internal Experience Higher Mental Processing Automatic Processing C Decoding Pain Stimulus B Encoding in Expressive Behavior Intrapersonal Influences Contextual Influences Message Clarit y Message Clarit y Automatic Processing Higher Mental Processing Verbal Pro gr ams N onverbal Pro g rams Observer Bias

PAGE 25

25 CHAPTER 2 REVIEW OF THE LITERATURE In order to appreciate the challenges encountered when attempting to determ ine whether a child with autism spectrum disorder (ASD) is in pain, one must be familiar with the specific nature of the disorder. The purpose of the followi ng review is to a) prov ide an overview of ASD, by describing current positions regarding prevalence and proposed etiologies, and by examining the specific strengths and wea knesses associated with children on the autism spectrum, b) explore communication theory, par ticularly as it explains the impairments in ASD, and focus specifically on the implications of this deficit s influence on pain expression, c) present a brief discussion of pain expression in normal children, d) review research focused on the development of pain assessment tools for use in several re lated vulnerable populations of children, e) explore the applicability of using these existing pain a ssessment tools in ASD, and f) discuss ethical issues pertinent to this research. Autism Spectrum Disorder (ASD) In 1943, an original paper by Leo Kanner de scribed the presentation of children who would later be labeled as autistic In his words, There is fr om the start an extreme autistic aloneness that, whenever possible, disregards, igno res, shuts out anything that comes to the child from the outside (Frith, 2003, p. 6). This aloneness emerges from a fundamental impairment in social interaction. It is this social impairment, along with impairments in communication, and the presence of restricted pa tterns of behaviors an d interests that ch aracterize a group of disorders known as autism spectrum disorder s (ASDs; Charman & Baird, 2002; Dover & Le Couteur, 2007; National Institute of Mental H ealth [NIMH], 2007; Walker et al., 2004). ASDs are sometimes also referred to as pervasive developmental disorders (PDDs), and the PDDs include autistic disorder, Aspe rgers disorder, childhood disinteg rative disorder (CDD), Retts

PAGE 26

26 disorder, and PDD-not otherwise specified (PDD-NOS; American Psychiatric Association [ DSM-IV-TR ], 2000; Volkmar & Klin, 2005). In clinical practice, Retts disorder and CDD are sometimes not included in the grouping of ASD, and therefore some sources may describe ASD as including autism, AD, and PDD-NOS (Kutscher, 2006). For the purpose of this review, ASD will refer to autism, AD, and PDD-NOS. These disorders are collectively described as a spectrum of disorders because the symptoms can occur in a variety of combinations and present with varyin g degrees of severity (Autism Society of America [ASA], 2006). The emergence of language describing a spectrum of disorders highlights the possible interrelatedn ess of these diagnoses and accommodates the nature of the variability in symptom severity of ten seen in children on the spectrum (Filipek et al., 1999). More recent atten tion to the category of PDDNOS has contributed to the conceptualization of a broader phenotype of ASD, as this category includes children who display various patterns of skills and difficultie s related to, but not adequately meeting the restrictive criteria for other pervasive developmen tal disorders such as Aspergers disorder, or autism (Dawson et al., 2002; Filipe k et al., 1999; Volkmar, Lord, Bailey, Schultz, & Klin, 2004). Despite the challenges encountered by clinicians regarding classification, all children with ASD have difficulties in the three previously described domains: social interact ion, patterns of communication, and restricted and/or repetitive behaviors or interests. Prevalence It was assum ed for many years that autism was rare, occurring at a rate of about four to five cases per 10,000 children. Prevalence report s in the late 80s and early 90s however, indicated that the rate of ASDs might be somewhere around 30 per 10,000 children, with about one quarter of those (10 per 10,000) meeti ng criteria for true autism (Filipek et al., 1999; Fombonne, 2003, 2005; Volkmar, Chawarska, & Klin, 2005). This alarming rise in the

PAGE 27

27 reported prevalence compelled many to explore why the number of children with ASD seemed to be increasing, and sparked debate about whethe r there is an autism epidemic (Barbaresi, Katusic, Colligan, Weaver, & Jacobsen, 2005; Barclay, 2005; Fombonne, 2001; Gernsbacher, Dawson, & Goldsmith, 2005; Newschaffer, Fal b, & Gurney, 2005; Williams, Higgins, Brayne, 2006). In response to the ci rculating concerns regarding the true prevalence of autism and related disorders, the Centers for Disease Control (CDC) conducted a study examining 8-year-old children living in 14 sites in the United States (C enters for Disease Control [CDC], 2007). Their findings state that 1 in 150 childre n are living with an ASD. The rate of autism in boys is about four times higher than in girls, with a reported ratio of 4.3:1 (Fombonne, 2005). According to the CDC, using this current prevalence data, we can estimate that if 4 million children are born in the United States ev ery year, approximately 24,000 of these children will eventually be diagnosed with an ASD (CDC, 2007, 2). In addition, the CDC points out that using this prevalence rate, if it has been constant over the past two decades, we can estimate that up to 500,000 individuals between the ages of birth and 21 have an ASD (CDC, 2007). After mental retardation (intellectual impairme nt), ASDs are the most common developmental disability (CDC, 2007). These st atistics are widely adopted and currently reported throughout the United States by organizations and experts fo cused on autism. The prevalence of ASD is currently higher than that of spina bifida, can cer, or Downs syndrome (Filipek et al., 1999; Muhle, Trentacoste, & Rapin, 2004; NIMH, 2007) Inadequate pain assessment in this population has national implications and potentially neglects the needs of a large population of children. Review of Possible Etiologies for ASD Unlike other m edical conditions where a precise causal mechanism can usually be delineated, the etiology of ASD continues to perplex many experts, clinicians, and researchers in

PAGE 28

28 the field. It is believed that autism is a neurobehavioral disord er and has no single cause (ASA, 2006; Happe, Ronald, & Plomin, 2006; Sunil, 2006) Growing evidence supports the idea that ASD may be caused by several factors, includi ng genetic susceptibili ty and environmental influences. The precise nature of the interpla y between genetic predisposition and environmental factors is the targeted question of many current research initiatives. The heterogeneity of the phenotype of ASD highlights the complexity scien tists encounter as they examine the proposed etiologies of ASD. There is emphasis on the impor tance of integrating findings from a variety of disciplines attempting to understa nd why children with ASD present with such varying degrees of difficulty in the three primary domains. The following sections will review current research initiatives exploring possible infectious, gastro intestinal, nutritional, environmental toxin, and inflammatory, metabolic, and neuroendocrine factors and ASD. Additionally, a few psychological perspectives are briefly presented. Genetic predisposition Fa mily studies have reported that there is a 60% concordance for classic autism in monozygotic twins versus 0% in dizygotic tw ins (Muhle et al., 2004; Sunil, 2006). When a broader phenotype for autism was used, the monoz ygotic concordance incr eased to 92%. These findings point to a strong genetic base for autism, but also highlight the fact that there are likely environmental or nongenetic factors influenci ng the expressionand t hus the severityof autism traits (Freitag, 2007; Muhle et al., 2004; Sunil, 2006; Szpi r, 2006; Zafeiriou, Ververi, & Vargiami, 2007). While most experts agree ther e is a strong genetic component to ASD, the more controversial discussions involve the nongenetic, e nvironmental factors that may influence the phenotypic expression of ASD. No particular environmental fact ors have been scientifically proven to trigger ASD, however current ongoi ng studies are examining the possible gene-

PAGE 29

29 environment interactions that may lead to th e development of ASD, and will hopefully provide more concrete evidence for particular culprits (Szpir, 2006). Environmental influences Several s tudies examining parental beliefs about the causes of autism demonstrate that there are a number of environmental factors cons idered to influence the development of ASD. Most commonly cited factors in clude immunizations (child a nd maternal immunization during pregnancy), environmental exposure (to infectio n, medications, toxins), intolerance to food (primarily those containing casein and gluten), and specific perinatal events (fetal distress or anoxia, prematurity, low birth we ight, uterine bleeding or indu ced labor; Harrington, Patrick, Edwards, & Brand, 2006; Mercer, Creighton, Hold en, & Lewis, 2006). In addition to those factors commonly mentioned by parents, other prenat al, perinatal, and post natal factors are under investigation (Kolevzon, Gross, & Reichenberg, 2007). It is not clear how, or whether, heavy metal exposure (mercury, cadmium, lead) might c ontribute to ASD. It has been hypothesized that children with ASD have a diminished ability to detoxify, and theref ore exposure to metals results in increased circulating levels thr oughout the body, and brain (Zafeiriou et al., 2007). Studies now underway are also i nvestigating the relationship betw een factors such as atypical placental growth, abnormal gut tissue, inflamed ti ssue in the brain, maternal and paternal age, and food allergies (Kolevzon et al., 2007; Neimark, 2007). What was once considered a primary disorder of the brain is now being conceptualized by some experts as a disorder whereby the interaction between genetic predis position and environmen tal factors leads to a change in cellular function. This then manifests itself throughout the body, and presents as an array of biological, neurological, and psychological abnormalities which have come to represent the autism spectrum disorders (Herbert, 2005; Neimark, 2007).

PAGE 30

30 Vaccines Issues involving vaccination con tinue to be a controversial to pic. There are two separate, but related, concerns regarding immunizations. The fist involves th e MMR vaccine and the belief that administration of this vaccine causes ASD in some genetically predisposed children. In 1998, a report by Wakefield et al. described 12 children who presented with ASD and comorbid bowel symptoms. He contended that children with regressive autism and bowel symptoms reflected a unique pr ocess linked to the MMR vaccine (Brown, Berkovic, & Scheffer, 2007; Francois et al., 2005; S ilverman & Brosco, 2007; Taylor, 2006). This proposition drew enormous attention from parents and clinicians. Despite criticism regarding the study design, the retraction of this interpretation by almost every co-author of the paper, rigorous follow-up studies, and the recent reports from the Institute of Me dicine (IOM) and the CDC that there is no causal relationship between the MMR vaccine and AS D, this issue remains at the forefront of many discussions and continues to be on the au tism research agenda (CDC, 1999, 2000; Institute of Medicine [IOM], 2001; Mu rch et al., 2004; Silverman & Brosco, 2007; Taylor, 2006). The second hotly debated con cern related to vaccination involves the sheer number of vaccines children receive, and th e possible relation of increased immunizations to the perceived increase in autism prevalence (Silverman & Brosco, 2007). Attenti on to the preservative thimerosal (which contains ethylmercury) in vaccines, has been postulated to cause neurotoxicity, and thus ASD. Removal of th imerosal, and subsequent research (IOM, 2004) does not reveal any link between immunizations and developmental disabilities, however it is acknowledged that additional research into this issue is imperative. Psychological perspectives During the first d ecades following Kanners de scription of infantile autism, there was tremendous focus on the parental role in th e psychogenesis of autism. It was wrongly believed

PAGE 31

31 that autism was a psychiatric diso rder resulting when parents did not provide adequate love, or failed to create a supportive environment for their children (Volkmar & Klin, 2005). Early treatment therefore, involved working with children and their parents (Silverman & Brosco, 2007). This theoretical framework was challe nged in the 1960s by Bernard Rimland (1964), who more accurately alluded to th e genetic component and neurolog ical nature of the disorder (Rimland, 1964; Silverman & Brosco, 2007). Investigation into the etiology of ASD has now crossed a myriad of disciplines including those that take a more biomedical and physio logical approach. The historical roots in psychology and psychiatry however, have resulted in a long tradition of successf ul research into ASD. Much of what is currently realized a bout the cognitive nature of ASD derives from psychological literature, and ma ny effective treatment protocol s are rooted in cognitive and behavioral therapy (i.e., Applied Behavioral Analysis (ABA)). Similar to the debated issues encountered in neurobiology, developmental psyc hology houses a variety of theoretical positions on the etiology of the core features found in individuals on the autism spectrum. Three commonly referenced theories include Weak Central Coherence (Frith, 1989) Executive Dysfunction (Ozonoff, 1995), and Mindblindedness (Baron-Cohen, 1995). Weak central coherence. Central coherence refers to ones ability to process information in its context; to create a highe r-level meaning from a variety of sources of input (Hill & Frith, 2003). Weak central coherence would manifest itself in a display of behaviors where an individual focuses primarily on pieces of information. Several behavi ors displayed in ASD support the notion that they have weak central coherence. For example, tests involving homographs (words with more than one definition i.e., read or present) reveal that normal children pronounce words dependent on sentence c ontext, while verbal children with ASD do not

PAGE 32

32 attend to the context of the sentence (Hill & Frith, 2003). Francesca Happe (1996) has extended these sentence findings and shows that struggles with weak coherence are manifested in lowlevel visual tasks as well. She poses that there is a bell-shaped distribution of coherence ability within the population of individu als with ASD, and that this might account for some of the variability seen regarding this cognitive ability. The weak central cohere nce theory is unique in that it not only explains several of the impairment s seen in individuals with ASD, but it also has explanatory power regarding the unusual streng ths present in this population. The embedded figures test (where a child must pick out a small piece of a global picture) is a test where children with ASD have been shown to excel. They ofte n perform better than typi cal individuals (Hill & Frith, 2003). Researchers hypothesize that a child on the spectrum is not distracted by the overall picture, and thus succeeds rather easily in these types of tasks. A number of tests and tasks have been developed to explore central cohe rence abilities in childre n with ASD. There is merit to this hypothesis in that it has the ability to explain some of the deficits and strengths witnessed in this population. Regarding the pain process, experts have id entified a number of ps ychological influences that may worsen, or minimize, a normal individuals pain experience. Part of interpreting a pain stimulus involves attributing higher-level meaning to the situation. If an individual is afraid, anxious, sees blood, or anticipates something is wrong, his or her percepti on of the experience might worsen. If children with autism have w eak central coherence, their attention to one specific perceptual process wit hout the added contextual information, might influence what is communicated to, or decoded by, a nearby observer. In fact, it might diminish the childs interpretation of the painful stimulus, and subsequently minimize what is communicated to, and thus interpreted by, others.

PAGE 33

33 Executive dysfunction. Weak central coherence seems a plausible explanation for several of the behaviors displayed by individuals with ASD. It does not, however, account for all of them. Nor is there a clear link between weak central coherence and other proposed causal theories. Similarly, executive dysfunction has explanatory power for several other behaviors witnessed in individual s in this population. Executive function refers to th e ability to perform such f unctions as planning, working memory, impulse control, shifting set, and th e initiation and monitori ng of action. (Hill & Frith, 2003, p. 285). The investigation of executi ve function in young children with ASD has historically been limited by the minimal number of ta sks available to test these cognitive skills at such a young developmental age. Recent attempts have been made to increase researchers abilities to examine executive function in young children (Hughes, 1998). Tasks appropriate for older children, such as the Towe r of Hanoi (measuring planning ab ilities), the detour reaching task (measuring inhibition of prepotent res ponse), and the Wisconsin card sorting task (measuring mental flexibility) reve al that individuals with ASD display marked disabilities in these areas (Hughes, 1998; Ozonoff & Jensen, 1999). The inability to plan accurately or resist internal impulses, and the me ntal rigidity evident in AS D supports the postulation that impairment in executive functioning might explai n the behaviors seen in this population. The severe resistance to change and repetitiveness of actions both also appear to be dysregulations in executive functioning. Mindblindedness. Mindblindedness, or more commonly referred to as the lack of a theory of mind, is the theory most developed in the autism literature (Baron-Cohen, 1995; BaronCohen, Tager-Flusber, & Cohen, 1993). Its wide acceptance is related to mounds of empirical work supporting the main assumption that individuals with ASD lack a theory of mind. The

PAGE 34

34 most significant deficits in chil dren with ASD involve social im pairment. Frequently, abnormal social interaction is the hallmar k characteristic that initiates a suspicion of autism (second to abnormal social interaction is language delay). Parents notice isolated be haviors early in their childs development. Thus, work has been done to explore the root of this social impairment, and to identify the aberrant cognitive structure responsible fo r the displayed behaviors. Theory of mind refers to the ability to unde rstand the mental states of others, and to appreciate the relationship between mental states and actions. Th eory of mind has traditionally been measured by false belief tests. Here, the pr esence of a theory of mind is reflected in an individuals ability to monitor a scenario and separate ones own thinking from the thought process of another, when both subjects have re ceived different information. For example, a box of crayons is presented to a child. Next, the box is opened to reveal that inside the box is, not crayons, but popcorn. The box is closed. Then the child is asked what Buddy (who has not seen inside the box) will think is inside. Individuals with autism commonly fail this type of task. They fail to realize that Buddy, who has not se en inside the box, cannot possibly already know that it does not contain crayons. Empirical work continues to support the exploration of theory of mind abilities in children with ASD, and yet many questions remain. The absence of a theory of mind is hypothesized to explain many of the so cial and communicative ch aracteristics seen in ASD. Because traditional theory of mind tasks eval uate the presence of theory of mind around four years old, researchers have sought to id entify cognitive structures which may act as precursors to theory of mind. Uta Frith (2003) describes theory of mind using the term mentalizing. She poses that the brain has an innate mechanism for processing other peoples mental states (p. 95). If mentaliz ing is innate, precursors to the th eory of mind measured at four

PAGE 35

35 years old might be identifiable. Suggested precu rsors include pretend play (metarepresentation), and joint attention (reflected in eye contact and gaze monitoring) (Charman, 2003; Morgan, Maybery, & Durkin, 2003). Joint attention is posited to influence the development of a theory of mind, and also the emergence of language (C harman, 2003), which may indicate that joint attention represents a more primary cognitive stru cture. Its impairment results in an absent theory of mind. Joint attention behaviors are id entifiable between six and twelve months of age. They involve dyadic or triadic sharing of attention between the infa nt, another person, and an object or event (Charman, 2003). Joint attent ion abilities have been empiri cally associated with language and social development. While associations ha ve been identified, less is understood about the exact neurodevelopmental mechanisms that might e xplain how deficits in joint attention evolve into theory of mind and language impairments. R ecall also, that early does not always indicate cognitive structures are innate. Joint attention may be a direct precursor to theory of mind development, but it is not well understood how join t attention develops, wh ether directly out of eye contact, or by some othe r unidentified mechanism. Deficits in these proposed precu rsors to theory of mind (joint attention and eye contact) might influence the development of appropriate pain understanding and expression in children with ASD. The following illustration adds clarity to this proposition. When a normal young child falls downassuming that the tumble was painful for a brief momentmost often the child glances upward in search of a bystander. Once identified, the child jointly attends to the recent event (the fall). The childs reaction is heavily influenced by the other persons reaction to his or her fall. Fear in the face of the mother might instigate a cry. The childs own embarrassment might result in crying. A smile on th e face of the mother, or the offer of comfort

PAGE 36

36 might diminish the desire to cry. Crying is an overt indicator of pain to many caregivers. The cry in this situation however, reflects an intr icate system of psychological processing. The psychological processing is blunted if the child fails to jointly attend to th e event of falling down. There may be no communicative interaction at all, and this may subsequently be misinterpreted that the child felt no pain during the fall. Only when it becomes unbelieva ble that a child could feel no pain (i.e., discovering the child has a br oken limb) might a care giver become overtly concerned. The exploration of this notion was th e premise for this research, and it is now clear that there may be a relationship between the so cial and communication impairments in children with ASD, and their ability to express whether they are in pain. Interrelatedness of psychological theories. Initially, each of th ese three described psychological theories originated to explain a single causal mechanism responsible for the clinical picture of ASD. However, it is becoming more apparent that no one theory can account for all phenomena seen in individuals with ASD. No single theory has successfully explained causality. Theory of mind approaches are limited in their ability to simultaneously explain executive dysfunction. Hughes (1998) asserts that execu tive functioning is crucial and primary to a childs development of a theory of mind. Ch allenging this contention, is the reminder that there are other clinical subpopul ations who suffer from executive dysfunction, and who do not have difficulty understanding others mental states (for example, schizophrenia, attention deficit hyperactivity disorder [ADHD], and frontal lobe syndrome) (Baron-Cohen & Swettenham, 1997). Several attempts have been made to integrate weak central coherence with the absence of a theory of mind. Jarrold (2000) asserts that weak central cohere nce is crucial and primary to a childs development of a theory of mind. Mo rgan, Maybery, and Durkin (2003) tested this

PAGE 37

37 relationship, and conclude that weak central coherence, joint atten tion, and verbal ability independently discriminate children with auti sm. Weak central coherence alone could not predict autism group membership. The debate remains unresolved. There are thr ee well-established theoretical approaches in psychology, with researchers from each position i nvested in uncovering the causal mechanisms of autism. Newer ideas aim to incorporate th e established theories, and seek to unify the different approaches. Future exploration might reveal explanations for the variability in symptom type and severity seen across the spectrum of autism disorders. In this light, it might be possible to explain why a variety of contradictory pain experiences are reported within this population. Clinicians, parents, and experts in autism have reason to be encouraged by the vast number of research initiatives aimed at understanding the cause(s) of AS D. Understanding the various theoretical positions regarding etiology allows one to consider how pain processing might be disrupted in this population. Core Features Exhibited by Children with ASD All autism spectrum disorders are characterized by three defining features: impairments in socialization, limitations in ve rbal and nonverbal communication, a nd the presence of restricted and repetitive behavior s and/or interests (DSM-IV-TR 2000; NIMH, 2007). Currently, general practitioners in clinic al practice utilize the Diagnostic and Statistica l Manual of Mental Disorders (DSM-IV-TR 2000) and the 10th edition of the International Classification of Diseases ( ICD-10; World Health Organization [WHO ], 1992) diagnostic criteria as formal guidelines for diagnosis of autism, Aspergers disorder, and ot her spectrum disorders not meeting full criteria for autism. The current criteria in the DSM-IV-TR and the ICD-10 classification systems allow for extreme latitude in interpretation on the pa rt of the clinician (V olkmar & Klin, 2005).

PAGE 38

38 Despite diagnostic limitations, it is important to discuss different manifestations of the core features and deficits that are associated with each of the autism spectrum disorders. Autism Typically developing infants are social beings (NIMH, 2007). Gazing at others, attuning to voices, holding fingers, and sm iling ar e natural social behaviors in infancy. Social impairments in autism therefore, often manifest themselves in poor eye contact, and the inability to utilize nonverbal gestures to manipulate the social envir onment, such as pointing or sharing gaze with others ( DSM-IV-TR, 2000; Dover & Le Couteur, 2007; NIMH, 2007; Volkmar & Klin, 2005). Younger children and infants do not imitate or play the same way as typically developing children. They often lack pretend play, and might s how little interest in things. As they grow, children with autism often do not develop peer re lationships appropriately and do not appear to respond emotionally to others. Ho wlin (1998) summarizes in detail the deficits seen in autism and discusses how older children lack social aw areness and thus may seem isolated from the world. They appear to not have feelings, and do not always seem sensitive to others. They may also act socially inappropriate at times. For example, verbal children with autism may ask an obese woman why she is fat. Communication impairments in autism manifest as either a delay in, or complete lack of, the development of spoken language. In individu als with verbal abilities conversation skills are limited, and they may demonstrat e repetitive use of language, or idiosyncratic language use ( DSM-IV-TR, 2000; Volkmar & Klin, 2005). Children with autism often repeat things or ask the same question over and over again. Parents of younger children ma y initially report a lack of babbling, or odd speech patterns in cluding echolalia (repeating or echoing others), and unusual tone or pitch. Many children with autism, if th ey do acquire some basic language abilities, have

PAGE 39

39 difficulty telling others what they want or need, and this can lead to frustration, anxiety, and even tantrum-like behavior. Restricted patterns of behavior interests, and activities co mprise the third category of impairment in children with autism. Child ren with autism might be preoccupied with a particular interest that is of a bnormal intensity or focus. They often demonstrate repetitive play, such as in excessively lining up cars. Many ch ildren with autism have motor mannerisms, such as hand flapping, which are repetitive in nature. Ch ange is often a stressful occurrence for them. They may have routines or patterns fr om which they cannot deviate. Deficits associated with true autism permeat e all aspects of the lives of the child and family members. Special consideration needs to be taken when working with these children and families, especially in healthcare settings, in order to be sensitive to the way children with autism experience the world. While the specifications fo r the diagnosis of autism have been delineated and widely accepted, there is controversy about how to accommodate all children who have a spectrum disorder, but do not meet the criteria for true autism. These children include those with Aspergers disorder, and PDD-NOS. Aspergers disorder (AD) The characterization of Aspergers disorder (A D) continues to create confusion and controversy among the autism community. While related to autism and PDD-NOS diagnostically (it is included in the DSM-IV-TR and its diagnostic criteria are identical to autism, with the exclusion of the communication criteria), the definition of AD is argued to be unique (Filipek et al., 1999). Some have referred to AD as autism without mental retardation, high functioning autism (HFA), or milder forms of autism marked by higher cognitive and linguistic abilities (Klin, McPartlan d, & Volkmar, 2005, p. 88). Despite the DSM-IV-TR diagnostic implications that there are no language impairments in AD, it is clear that language in

PAGE 40

40 children with AD disorder is not typical. Examples of current research include attempts to define whether there are distinctions between AD and HFA, and the consideration that perhaps a broader phenotype of AD might in clude relatively successful indivi duals who are not necessarily disabled (Klin et al., 2005). Children with AD sh are many of the same features as children with autism, but do not have a history of language delay and usually have aver age or above average intellectual abilities (Klin et al., 2005; Pratt & Buckmann, 2006; Sunil, 2006). Socially, children with AD may not appear as withdrawn as children with autism, but they tend to approach others in inappropriate or eccen tric ways (Klin et al., 2005). Children with AD do befriend others, but inherent in their friendships are difficu lties related to awkwardness and perceived insensitivity on the part of others. They participate in conversation, but have a tendency to only discuss topics they are interested in and fail to banter back and forth as in typical two-way conversation. Their inability to understand the rules of interaction, and poor comprehension of jokes and metaphor, can lead to feelings of isolation and embarrassment. Children with AD may have flat and emotionl ess speech. They are often obsessed with particular topics, may ask repetitive questions, and display c oncrete, literal thinking. Their circumscribed interests lead them to learn volume s of information about a particular topic in a very intense nature. For example, a child might know or want to learn absolutely everything about vacuums, from how they are built, the hist ory of when they were invented, down to the make and model of every vacuum in existen ce. Some children with AD display eccentric behaviors (Belschner, 2007). Children with AD usually have a history of poor motor coordination. Parents often describe them as clumsy. The intentional focus on AD and its relation to the other spectrum disorders has led to a revitalization of research examin ing this particular population. Th e heightened attention has led

PAGE 41

41 to discussion about definition, causality, detailing its relationshi p to other spectrum disorders, and targeting interventions specifically de signed to work w ith these children. Pervasive developmental disorder-n ot otherw ise specified (PDD-NOS) PDD-NOS, also referred to as atypical autism, is referenced when there are clinically significant autistic symptoms, but not quite enough to meet the full criteria for true autism. It is not a separate disorder with di fferent manifestations, and ther efore, many of the previously described manifestations are applicable to this population. Children with PDD-NOS are sometimes considered to demonstrate a mild er symptomatology. Diagnosing PDD-NOS is a diagnosis by exclusion, when a child cannot be ca tegorized into one of th e other autism spectrum diagnoses. One report describes children with PDD-NOS as being midway between the autism and AD groups on IQ, measures of adaptive behavi or, and language milestones (Walker et al., 2004, p. 178). They are on the spectrum, are hi gher functioning than autism, have fewer repetitive behaviors than autism and AD, and have more delayed language than children with AD (Walker et al., 2004). Communication Impairment in ASD From a very young age children learn that they live in an interactive world. The world stimulates them, it responds to them, and they quic kly realize how to inter act with the world in order to elicit those responses from others. These basic realizati ons foster a sense of connectedness to the environment. To some who study the nature and development of communication, these early infant realizations are presumed to lay the foundation for the emergence of the ability to communicate. So mething goes awry, howev er, in children with ASD, rendering them unable to communicate in the same manner as other children. Impairments in communication are the focus of many different studies found throughout the autism literature, and have the potential to significantly alter and/or limit pain expression. If

PAGE 42

42 children with autism are known to have social and communicative impairments, it is unlikely thataccording to The Communications Mode l of Pain (Hadjistravopoulos & Craig, 2002) their pain experience would go uninfluenced. Theoretically, th ese children have inherent difficulties when it comes to expressing pai n. In order to thor oughly understand how the impairments seen in children with ASD might influence their understanding and expression of physical pain (bumps, bruises, burns, etc.), it is necessary to examine communication, and specifically, the development of th e ability to communicate in ASD. This section aims to describe several cu rrent theoretical perspectives found in the communication and language literature, in an effo rt to begin to understand how impairments in this specific domain might influence a childs ability to express pain. Several of the longstanding debatable issues that are commonly addr essed in the language development literature are presented. Theories that attempt to explain the impairments seen in children with autism are explored. Finally, a more in-depth examin ation of specific communication and language impairments seen in children with ASD, as th ey might influence pain expression, is presented. The pain experience is a complex, multidimensional process involving different components of the brain and centr al nervous system. Similarly, pain expression is a complex, multidimensional process. Rather than cons ider how children with autism may uniquely experience pain, some individuals assume that the impairments inherent in children with ASD actually diminish or negate pain processing altogether. This is perhaps a result of the fact that many children with ASD do not express their physic al discomfort in a typical manner (i.e., cry, moan, seek comfort, etc.). To date, many case studies and personal testimonies published in the literature on autism describe sensory and per ceptual abnormalities (Bursch, Ingman, Vitti, Hyman, & Zeltzer, 2004; ONeill & Jones, 1997). Some individuals with ASD do experience

PAGE 43

43 alteration in auditory, tactile, and/or visual sensory processi ng. Caregivers describe the difficulties they encounter when their children with autism are upset secondary to altered sensory perception (Zeltzer & Schlank, 2005). In addition to sensory alterations, caregivers describe unusual, or absent, responses to painful stimuli in their children with au tism. Others however, can describe unique behaviors that alert them to their childs being in pain. Altered pain expression is not universally observed in ASD, bu t most experts agree that the pain experience appears different in this population. It is possible that impairme nts in communication influence how pain is expressed in these individuals. Overview of Communication Theory Frank E. X. Dance (197 0) reported that there are around 100 published definitions of communication. The conceptualization of comm unication has been addressed from a wide range, and diverse set, of disciplines. For these reasons, it is nearly impo ssible to construct one single, comprehensive, working definition of communication. The definition must take on the form most appropriate for the particular purpose or inquiry. Despite the diversity, many communication experts identify and a ddress the various properties cen tral to most definitions of communication. In his text, Wood (1982) describes five premises that are foundational to a working definition of communication. He emphas izes that communication is a dynamic process, and that it is systemic. He points out that the w hole is greater than the sum of its parts, that communication is symbolic intera ction, and finally, that meaning in communication is personally constructed. The model he believes capture s these described premises is a Symbolic Interactionist Model of Co mmunication, which emphasizes dynamism and also the shared experience crucial to the overall function of communication. Th is trend from a more actionoriented model of communication towards an interactional, and ultimately transactional model of communication has been noted in other texts on communication theory as well (Budwig,

PAGE 44

44 Wertsch, & Uzgiris, 2000; Leeds-Hurwitz, 1989; Smith & Williamson, 1977; Watzlawick, Beavin & Jackson, 1967; Wood, 1982). Bowers and Bradac (1982), similar to Wood (1982), published a number of competing axioms they believe comprise a foundation for communication theory. They list seven sets of axioms, which include, as one ex ample, the notion that while a) communication is the transmission and reception of information, it is also b) the generation of meaning. While a number of communication theorists aim to better define communication, and their work reflects the evolution and adaptation of mo dels attempting to define communication, other theorists explore a variety of other aspects of communication. Different disciplines generate different research programs, each aimed at addre ssing a particular resear ch question related to communication. Communication re search encompasses all issu es related to how and why humans communicate, from interpersonal comm unication, communicatio n methods used in educational settings, to mass media communicati on. Many of these theoretical frameworks are beyond the scope of this review, as they are not direct ly related to the re search question these studies addressed. The particul ar aspects of communication theo ry most applicable to this review include those foundations which addre ss the social aspects of communication, and additionally, how language is used (or not used) as a means of co mmunication. In an attempt to understand the deficits seen in children with au tism, and to discuss how different impairments might influence the verbal and nonverbal expressi on of pain, it is necessary to examine the closely related, but somewhat separate, body of literature focused on language development and use. Language and Communication Language and communication are intim ately re lated. The nature of the relationship however, is one of the controvers ial issues articulated throughout the language literature. For

PAGE 45

45 example, Hoff (2005) points out th at there are different camps re garding whether the desire to communicate is the motivation for acquiring language. Several theo rists focus on the childs desire to share experience and express themse lves as the impetus for language emergence. Others counter argue that the complexities of grammar cannot be learned simply by the motivation to communicate, and they pose that these theorists give childr en too much credit when it comes to assuming they have such a sound social understanding (Hoff, 2005). This debate is also sometimes referred to as part of the formalis m vs. functionalism debate. Formalists regard language acquisition as a separate module of development, completely independent of communication (and other social or cognitive processes for that matter). This modular conceptualization derives historically from Chomskys articulation of language as a mental organ, and was further explored by Fodor (1983). Functionalists, on the other hand, tend to describe the process of language acquisition in light of the other cognitive capacities that are developing simultaneously, including the desire to socially in teract and communicate. They articulate how the interacti on between the use of language and the environment (other individuals), fosters the con tinued development of language and communicative capacity. Interestingly, some children with autism develop language skills, but fail to utilize language to successfully communicate, lendi ng support to the notion that language and communication are perhaps in some unique way distinctly separate. In examining the relationship between language and general cognition, Marcus and Rabagliati (2006) address the modul arity vs. domain-general deba te and provide insight into a possible compromise. They propose a theory whereby cognition and language share a common background from an evolutionary standpoint, an d have only recently diverged due to small changes. Thus, while distinct in some ways, they are also related, and research may ultimately

PAGE 46

46 shed light on how language builds on and depart s from particular aspects of domain-general cognition (p. 1228). Marcus and Rabagliati poin t out that developmental disorders such as ASD, might be better accommodated by such an approach, and thus would explain why some children develop linguistic ability while remaining unable to communicate effectively. Language Development When theorists m ove beyond examining the nature of communication and how it relates to language, and attempt to specifically explain the development of linguistic competence in the early years of life, several vividl y different research enterprises can be identified. Despite ones approach towards the study of language, there are se veral major issues that every theory attempts to address and which continue to be pertinent issues in the field. These issues involve the initial state of knowledge regarding language, the proce ss of developmental change, and the role of external input influencing the development of language. The fo llow paragraphs highlight the most debatable issues that have historically laid the foundation for different camps within language development theory and research. Innateness One of the most long-standing debates invo lves the issue of innateness. Rapid developm ent regarding the study of childrens language followed a public ation in the 1950s by Noam Chomsky. The debate that ensued betwee n Chomsky (a nativist) and B. F. Skinner (a learning theorist) facilitated the emergence of two divergent positions regarding the origins of language. Chomsky focused on the grammar of ch ildren, and posited that there is an innate Universal Grammar (UG) whereby interaction with this UG (input from environment), and the presence of innate constraints, allows for the growth of a knowle dge of language. Nativists point to the ease and rapidity with which children acquire language, and also argue that even without implicit instruction children develop language abilities (Meltzoff, 1999). Skinner however,

PAGE 47

47 espoused that the environment shapes the deve lopment and emergence of language without the original presence of anythi ng innate. The current state of this framework is usually referred to as connectionism. This initial debate ignited and fu eled language research, br inging it ultimately to the body of knowledge that is e xplored and expanded today. Current theoretical positions ha ve, in a sense, rejected th e pure behaviorist approach. Almost everyone agrees that there is something innate about the acquisition of language, and that it is the interaction of the innate capabilities with the environment th at best describe its emergence. The debate currently ensues re garding the nature of the innateness and the interaction, and it is in this realm that most theories currently differ. Developmental changes In order to understand w hat is innate in language, theorists must describe the process by which infants and children take that innate cap ability and develop language. Explanations for the process by which individuals l earn language vary significantly. Several particular issues are commonly addressed when referring to the deve lopment of language. These include explaining the process by which children acquire language, cons idering whether there ar e particular critical periods during the development of language, and examining the influence of input from the world on language development. Processes A variety of models attempt to detail the m echanism by which language abilities emerge. Modern research programs utilize newer tec hnology and methodology and have been able to gain detailed insight into the processes by wh ich children learn languag e. One segment of theoretical work focuses on babies abilities to identify patterns, learn rules, and even utilize statistics during language development. Work by Saffran, Aslin, and Newport (1996) emphasizes the unique ability of babies to iden tify patterns and use a form of statistics to

PAGE 48

48 organize the sounds they hear and develop langu age. Pinker has writtenin light of learning rules and setting parameterst hat babies however are not ac quiring dozens or hundreds of rules; they are just setting a few mental switches (Akhtar, 1999, p. 340). Pinker also focuses on how children link rules based on an innate knowledge of word categ ories. Patricia Kuhl (2000) accounts for all concepts: rules, patterns, and statis tics; in addition she identifies other influences, such as experience, that likely shape language development. She concludes that they use inherent learning strategies that were not expected, ones thought to be too complex and difficult for infants to use (p. 11856). Recently, Kuhl examined speech and linguistic processing in children with autism (Kuhl, 2005). Conclusions from this work indicate that there is a link between social interaction and language learning. This notion th at social interaction is pr imal to the development of communication and language is historically based in writings by Vygotsky (Budwig et al., 2000). The process by which social functioning infl uences the development of communication and language is theorized by severa l different well-known resear chers (Bruner, 1983; Snow, 1999; Tomasello, 1992). These frameworks are often referred to as so cial-pragmatic approaches. Tomasellos approach however, has been referred to as cognitive-functional linguistics, and most recently has also been called usage-based lingui stics (Tomasello, 2003). The details of his theory will be discussed later in light of e xplaining particular f eatures of autism. Critical periods and continuity One issue commonly addressed by communica tion and language theo rists involves the conjecture that there are critic al periods in language developm ent, where children are able to acquire and use language rapidly. Beyond these critical periods, it is proposed that language processing is different. The critical period hypothesis is supported by several different arguments. One argument highlights the fact that children learn language at an extremely rapid

PAGE 49

49 pace, and also points out that children are able to acquire a second-language with greater ease than adults. Additionally, isolated case reports of children rais ed without exposure to language, highlight how the children remain mute and acquire relatively little language ability if intervention occurs after a certain point in development. Those who disagree with the conceptuali zation of a critical period emphasize the continuous nature of communica tion and language development, and present counter arguments to the points mentioned above. They discu ss how adults learning second languages have a longer history of utilizing and working with their first language, which interferes with the ability to learn the second language. They also point out that children in general, across a variety of skills and cognitive capacities are more flexible le arners, aiding their abi lity to acquire language faster than adults. Patricia Kuhl (2000) highlights the learning strategies she has found employed by infants and reinterprets the criti cal period for language (p. 11850), stating that the critical period for language depe nds on experience, not just ti me (p. 11855). By experience, she refers to the neural commitment that is a result of experience. Each theoretical perspective on communication and language theory generally accounts for the previously discussed issues: the nature of what is inna te, and how the innateness translates via different learning processes and mechan ismsinto a functional language used to communicate. Additionally, in describing proposed processes and mechanisms, theorists address historically debated issues th at have divided communication a nd language researchers such as continuity vs. discontinuity, and the critical period hypothesis. The following section will explore how theories that emphasize the social-cognitive nature of communication and language development explain the deficits seen in children with autism.

PAGE 50

50 Communication Impairment and Its Infl uence on Pain Expression in ASD Social and comm unicative deficits are core features of autism spectrum disorders. Many theorists attempt to explain the unique features se en in these children in light of the theoretical frameworks previously described. Those inte rested primarily in communicative impairments will re-visit what is believed about normal pa tterns of language development, and speculate where deviations in autism occur. Despite va rious theoretical perspect ives on language origin and development, there are several widely ac cepted beliefs about communication and language in ASD. As theories are explained in greater detail however, differen ces frequently emerge. It is generally agreed that an initial impai rment most likely occurs early in development (Lord & Paul, 1997). The impairment must lend to a range of consequences, because in autism, language abilities are highly variable. Language impairment is related t o, but not necessarily a result of, social and cognitive function (Lord & Paul, 1997). Despite deficits, progress within each domain of language usually follows a similar pathway as that of typically developing children. Lord and Paul (1997) refer to two general orientations towards autism: those with the modular approach (theory of mind, central cohere nce, and metarepresentation frameworks), and those with an information processing approach (executive function). They resolve that both orientations address how communi cation development is altered, and do so differently. Martin and McDonald (2003) address pragmatic language disorder and explore how it relates to weak coherence, theory of mind, and executive dysfunc tion. They conclude that all three processes can predict pragmatic language disorder, but do not specific ally address the underlying mechanisms responsible for the communication impairment. In examining the course of communicativ e competence and language development, theorists attempt to identify early indicators of communicative impairment and have identified preverbal behaviors that are directly related to the subsequent development of more complex

PAGE 51

51 communicative, and eventual linguistic abilities. Mitchell et al (2006) found that communication and language delays can be pred icted by monitoring for delays in specific gestures. Other preverbal and so cial abilities strongly linked to the development of language and other communicative abilities include joint attention skills. Examples of joint attentional skills that children with autism either lack, or ha ve difficulty with, include referential looking, declarative pointing and showi ng, looking where others point a nd look, and social referencing (Carpenter & Tomasello, 2000). Joint attention is a precursor fo r other capabilities, such as engaging in role-reversal imitation, and unde rstanding communicative intentions. Tomasello (2003) published a usage-based th eory of language acquisition and thus produced one of the most comprehensive theo ries of communication from the functionalist perspective. He focuses on defining how one understands the communi cative intentions of others, and desires to share or di rect the attentional st ates of others. This, according to him, facilitates the emergence of language. He empha sizes the communicative na ture of interactions, even if there is minimal language exchange, a nd focuses on how the interaction itself can teach additional communicative skills. He also links gestures, such as pointing, to the emergence of an intersubjective experience from which lingui stic symbols are used to communicate. These basic, foundational social-cognitive skills are altered in individuals with ASD. What remains unclear is exactly how, or to what extent, these abilities are impaired. One of the most perplexing concerns to those who work in the field of autism is the extreme variability found along the spectrum, including variability in the communicat ive and language abilities of individuals. Most theories are un able to completely address this pa rticular issue. As a result, it is difficult to generalize research findings. Interventions and tr eatments therefore, must be tailored to each specific chil d. Additionally, the variability implies that each childs pain

PAGE 52

52 experience, and thus ability to express his or her pain, may be a highly individualized phenomenon. This review of communication impairments in autism explores how particular deficits in social-cognitive and communicative skills might relate to the pain experience, and allows one to begin to approach the pain experience in children with ASD thoughtfully. Pain Assessment in Children The body of literature regarding the pain experience in typica l, healthy children has grown rapid ly over the past two decades. Significan t advances have improved the assessment, measurement, and treatment of pain in children of all ages. National orga nizations dedicated to the care of children have begun to acknowledge the prevalence of pain (acute, chronic, procedural, etc.) in this populati on. International efforts to exam ine the prevalence of pain in children, and attempts to characterize their pain have allowed investigator s to begin to quantify the presence of pain in children and adolescents. A recent article by Roth-Isigkeit, Thyen, Stoven, Schwarzenberger, & Schmucker (2005) fro m Germany published pain prevalence rates as high as 83% (n=739) when children were asked to report if they had e xperienced pain in the previous three months. Of children in the United States, 20% (aged 5-17) suffer chronic headaches (Zeltzer & Schlank, 2005). Zeltzer & Schlank (2005), experts in managing chronic pain in children, also report that juvenile arthri tis is one of the most co mmon chronic diseases in childhood, and that the prevalence of fibromyalgia is at least as high as 6% in school-age children. It is estimated that up to 20% of children suffer from some sort of chronic pain condition (Bassett, 2005). As the understanding of th e prevalence and nature of pain in typically developing children increases, additional work into assessing and managing pain in subpopulations of vulnerable child ren becomes imperative. Currently, there is ample research devoted to developing, validating, and modifying tools for assessment and measurement of pain across all ages in typically developing children. There

PAGE 53

53 are behavioraland physiologically-based tools for neonates and infants (Johnston, Stevens, Boyer, & Porter, 2003), and ther e are now developmentally appropriate self-report tools that have been modified for young and school-age children (Champion, Goodenough, von Baeyer, & Thomas, 1998; Gaffney, McGrath, & Dick, 2003). These instruments have been adapted and validated for use in a variety of settings (i.e., inpatient, outpatient, schoo l) and under a variety of circumstances (i.e., children with cancer, or children after surgery) There are tools available to characterize the quality of different types of pain (i.e., acute, chronic, neuropathic), and also to monitor the effectiveness of diffe rent treatments (i.e., measuring for changes in pain scores). Additional bodies of literature focus on chronic pain management in children, while some even focus on the pain associated with specific dis ease processes. The na tional recognition of the importance of pain assessment and management in children has led to the establishment of pain clinics, where entire teams of professionals are dedicated to helping children in pain. It is unreasonable to think that children w ith disabilities or deve lopmental disorders are exempt from the pain prevalence reports describe d earlier. Alternativel y, several pain experts posit that the prevalence rates of pain would logically be higher in these children (McGrath, 1998). Stallard, Williams, Lenton, & Velleman (2001) report that everyday pain in cognitively impaired, noncommunicating children is commo n, yet rarely treated. When specifically considering children on the autism spectrum, one needs to recall the commonly reported hypersensitivities and the variety of behavioral tendencies these children exhibit. Zeltzer & Schlank (2005) propose that children with alread y altered neurological systems will experience, and thus respond to, basic pain se nsations differently. Bursch et al. (2004) posit that abnormal sensory processing will not eliminate the ability to feel pain, but it might affect the cognitive interpretation of the sensory experience. Additionally, in children with ASD, several

PAGE 54

54 investigators propose that the anxiety often experienced by this population might actually contribute to the presence of pain, es pecially in those whose muscles remain tense for long periods of time (Zeltzer & Schlank, 2005). Many children in these vulnerable populati ons endure medical procedures and everyday painful events similar to typi cally developing children, if not in greater frequency. It is imperative that the current movement to examin e and better understand pain expression and management in these groups continue. In preparation for discussing the development of an instrument for use in ASD, the remainder of this literature review closel y examines the research that informs what is known about pain assessme nt in some similar, but distinctly different, populations of childrenthose wi th cognitive, neuromuscular, communication, and/or other developmental disabilities. Pain Assessment in Vulnerable Pediatric Populations Despite the wealth of information available on pediatric pain assessmen t, there is a paucity of research focused on pain assessment in children with cognitive, neuromuscular, communication, and/or developmental disabilities While children with ASD display some similar characteristics, and it might appear on the surface that a single pain assessment tool would be appropriate for all of these subpopulati ons of children, there are significant differences warranting an investigation of whet her children with ASD require a distinct pain assessment tool. Children with ASD are not always cognitively impa ired, and the combination of their social and communicative impairment is un ique to this population. Initial studies examining pain expression in ch ildren with disabilities reveal that it is inappropriate to use pain asse ssment tools currently available for typically developing children with these populations (Oberla nder & Craig, 2003). Children with disabilities co mmonly exhibit cognitive, motor, neurological and communicative impairment s which confound traditional

PAGE 55

55 assessment tools and lend to inaccurate measurem ent of pain. For example, facial and spastic movements, guarding, groans, and tears may be associated with pain expression in the typical, healthy child. Some children with disabilities ho wever, display these behaviors as part of their daily, nonpain repertoire of expre ssions (Oberlander & Craig, 2003). It is therefore impractical to consider these behaviors as indicative of pain in all children with developmental disabilities (Breau et al., 2000). Regarding self-report m easures of pain, many children with cognitive and communicative impairments are unable to look at a se ries of faces (i.e., the Faces Scale) and selfreport which face reflects how they feel at the time. In the mid-90s, after realizing the limitations of available pe diatric pain assessment tools, several researchers focused on developing assessm ent tools applicable to specific groups of children; namely, those children with various deve lopmental disabilities. Behavioral assessment tools have subsequently emerged in the literature, and are now available for use in children with a) cerebral palsy (CP), with or without severe neurological impairment, b) infants and neonates withor at risk forneurological impairment, c) children with cognitive impairment and/or developmental delay, and d) children with cognitive impairment and the inability to communicate verbally. While thes e populations are somewhat simila r in nature, and researchers acknowledge overlap, they also emphasize the importance of c ontinuing to validate pain assessment tools in each specifi c population. The following sections review pain assessment tools currently available for these vulne rable populations of children. Cerebral Palsy and Neurological Impairment Giusiano, Jim eno, Collignon, and Chau (1995) first examined pain expressive behaviors in children with CP and neurological impairment. They developed a pain assessment tool comprised of 22 items and called it the Evaluation Scale for Pain in CP. They derived their items from behaviors that physicians identified as indicative of pain in children with CP during a

PAGE 56

56 physical exam. The initial publ ication of this scale did not provide information on its psychometric properties. A follow up study by Collignon and Giusiano (2001) however, indicates that they have further developed and te sted the scale, creating a 10-item list of pain expressive behaviors for use in children with CP. They discuss validation of this newest version of the scale, and report that it demonstrates good psychometric propertie s. The ten identified pain indicators include: crying du ring manipulation, painful e xpression, int erest in the surrounding, increased tonus problems, coor dinated defensive reaction, moaning or inaudible cries, inability to communicate with nurse, increase in spontaneous movement, protection of painful areas, and observing pain-easing post uring. The final ten items reported by this group are similar to findings by McGrath, Rosmus, Canfield, Campbell, and Hennigar (1998). These researcher s were developing a pain assessm ent scale at the same time. Their scale, and its subsequent developm ent, is discussed in a later section. Hadden & von Baeyer (2002) extended the findi ngs of Giusiano et al. (1995) and McGrath et al. (1998) and worked to furt her explore the previ ously identified pain indicators in children with CPspecifically looking at those children with CP and severe neurological impairment. They sent surveys (The Caregiver Pain Survey) to parents of children with CP and asked 27 probing questions about pain expres sive behaviors in their childre n. They incorporated 24 of the indicators included in the a ssessment tool developed by McGr ath et al. (1998). The most frequently reported pain indica tors include: crying, less active, seeks comfort, moaning, not cooperating, irritable, stiff/sp astic/tense/rigid, decrease in sleep, difficult to satisfy or pacify, flinches or moves body pa rt away, and agitated/fidgety. Neonates at Risk for Neurological Impairment Several publications have em erged from a gr oup of pain researchers describing the pain experience in neonates at risk for severe neurological im pairment. Stevens et al. (2006) describe

PAGE 57

57 a process whereby 14 pediatric pain experts determined the usefulness of 39 pain indicators used to assess pain in the neonatal population. The original list of 39 indicators was developed by the investigators. After two Delphi rounds with e xperts, they identified seven indicators that had high ratings of usefulness and importance. Thes e include: brow bulge, facial grimace, eye squeeze, inconsolability, increased and/or fluctuations in heart rate (from baseline), and reduced oxygen saturation. These identified behaviors support what has already been determined about pain assessment in neonates that assessment relies heavily on facial and physiologic indicators. Their st udy reveals that even with neur ological impairment, or other neurodevelopmental disorder diagnoses, pain assessment involves observing for specific facial responses and monitoring for changes in physiologic parameters. Children with Cognitive Impairment Not all children with profound cognitive im pair ment have simultaneous motor difficulties (like those seen in CP). Child ren with cognitive impairmentwhose daily functioning is typical in regards to movement and activitycomprise another population where preliminary pain assessment work has been conducted. Terstegen, Koot, de Boer, & Tibboe l (2003) developed an item pool of 138 potential pain indicators for this population (based on a quasi-qualitative study). While all children had profound cognitive impairment, not all children suffered from motor impairment. They subsequently observed (by video) children post-surgically, to watch for how often the potential pain indicators were present. Twenty-three reliable, observable indicators showed sensitivity to pre and post surgical observ ations. The most sensitive indicators were from the category Facial Expressions, which includes 10 behaviors. Other categories include Motor Behaviors (i.e., tensed up), Soc ial Behavior/Mood (i.e., panics, accepts comfort, and rebellious), Vocalizations, and Physiological Signs. For the first time, Terstegen et al. (2003) speak to the social-c ommunicative impairments sometimes seen in

PAGE 58

58 children with cognitive impairment, and thus first identify another dimension important to consider in pain assessment. Non-Communicating Children with Cognitive Impairment The developm ent, and subsequent publication, of these various pain assessment tools has been somewhat simultaneous. Thus, there is overl ap within the research, and it is difficult to describe how each assessment tool builds upon the others. The benefit however, of having tools emerge around the same time for similar populations, is that comparison of each instrument reveals stark similarities and differences. There are solid commonalities amongst the tools available for each population, but ther e are also subtle differences that speak to the nature of each specific population. This premise supports the argument that a pain assessment tool specifically for use in ASD is warranted. One of the more widely available, well deve loped and validated instruments available for use in children with cognitive impairment and communication impairment is the previously mentioned assessment tool developed by McGrat h et al. (1998). McGrath and colleagues utilized caregivers of children with CP to generate a list of behaviors they typically use to discern the presence of pain in their children. Of note, none of the caregivers interviewed had a child with ASD. They identified 30 behaviors and put them into 7 categories, which include Vocal, Social, Facial, Activity, Body and Limbs, Physiological, and Eating/Sleeping. In a subsequent study, Breau et al. (2000) further tested this ch ecklist, now titled the NonCommunicating Childrens Pain Checklist, utilizing a group of 32 caregivers. Eight of these caregivers had a child with autism/PDD, however no children with ASD are reported to have been included in any of the subsequent validati on studies (Breau, Finl ey, McGrath, & Camfield, 2002; Breau, McGrath, Camfield, & Finley, 2002). Preliminary validation indicates that the checklist exhibits internal cons istency, and can detect pain and is reliable over time. They note

PAGE 59

59 that the checklist needs furt her evaluation, specifically in other groups of children with impairments, and that it should be determined whether the checklist would be helpful to providers in the clinic or inpatient setti ng who might not know the children intimately. A revised version, The Non-Co mmunicating Childrens Pain Checklist Revised, (Breau, McGrath, Camfield, & Finley, 2002) and a post operative version, The Non-Communicating Childrens Pain Checklist Postoperative Version (Breau, Finley, McGrath, & Camfield, 2002) have been subsequently validated and are now ava ilable. The revision did not change any of the thirty pain expressive behavior s, but simply re-worded several of the items, and changed the response format for each item from present/absent, to a 4-point Likert scale. The postoperative version is similar to the original checklist; how ever it does not contain the Eating/Sleeping items because these are not direct ly relevant to postoperative pain in the clinical setting. The postoperative version demonstrates good psychometric properties and it is reported that this scale is valuable when assessing pain in children with intellectual impairments postoperatively. Additional development from this initial work with the Non-Communicating Childrens Pain Checklist has resulted in a) identification of a subset of seven items (not cooperating, cranky, irritable, unhappy, seek s comfort or physical closene ss, change in eyes, including squinching, eyes wide open, eye fr own, not moving, less active, qu iet, gestures to or touches part of the body that hurt s, tears, and gasping) that can successfully predict pain in children with cognitive impairment who cannot comm unicate (Breau, Camfield, McGrath, Rosmus, & Finley, 2001), and b) another attempt to develop a checklist aimed at assessing chronic pain in children without CPbut who have a wider range of cogn itive impairment and the inability to communicate (Stallard, Williams, Velleman, Lenton, & McGrath, 2002).

PAGE 60

60 This development by Stallard et al. (2002) i nvolved caregiver interviews whereby 203 pain cues were identified and subsequently examined by experts. They identi fied six cues used by 90% of caregivers as indicators of pain. These include: crying, screaming/yelling, distressed face, tense body, difficult to comfort, and flinches if touched. The investigators report that despite asking about chronic pain, these cu es tend to identify acute pain responses, and they highlight the difficulties encountered when a ssessing chronic pain in these populations. They also mention that even though this scale was develope d utilizing parents of children with a wider range of cognitive and comm unicative impairments, its usefulness in some groups of childrenspecifically children with ASDis still questionable and needs to be explored. Stallard et al. continued work with these six identified cues and tested the instrument they developed and titled the Pain Indicator for Communicatively Impair ed Children (PICIC). They used 67 caregivers of children with central nerv ous system disorders (no children with ASD). They found that 5 cues were correlated with care giver judgments of pain, and that the presence of one observable cue (screwed up or distressed looking face) co rrectly identified almost 72% of the children in pain, and 93% of the children not in pain. Interestingly, crying was not a useful indicator of pain, given that many pare nts acknowledged the presence of crying in a number of distressing situations other than pain. One of th e more novel findings in this particular work was the addition of pain cues by caregivers. Ca regivers noted that he or she sometimes pushes me, bites bottom lip, m oves from one place to another, claps his hands, bangs head, laughs, rubs head, and/or bites, when in pain. The PICIC might be a useful caregiver tool, but may not be helpful to individuals unfamiliar with the child, and the additional items noted by caregivers speak to a) the intimate knowledge caregivers have

PAGE 61

61 regarding pain in their children, and b) the fact that pain expression in children with cognitive and communicative impairment may be quite individualized. Acknowledging the individualized nature of pa in expression in these special populations, Solodiuk and Curley (2003) developed The Indivi dualized Numeric Rating Scale (INRS) to help assess pain in children with cognitive impair ment and communication difficulties. Their assessment scale is not a check list, but rather resembles a process by which a childs personal pain profile might be generated. It asks caregivers to think a bout their childs past painful events, provides specific indi cators they might take note of regarding facial expression, body movements, activity, soci al interaction, cry, and consolabilit y, and then asks caregivers to describe what their child does when in: no pain, moderate pain, and severe pain. The resulting picture of the child in pain is then provided to individuals i nvolved in his or her care (i.e., nurses, physicians, teachers, therapists, etc.). This novel approach speak s to the uniqueness of each childs individual expression of pai n, however it requires that a caregiver know what his or her child does when in pain. Finally, two additional qualitative studies dire ctly address the experience of pain in children with special needs and severe neurologi cal impairment (Carter, McArthur, & Cunliffe, 2002; Hunt, Mastroyannopoulou, Goldman, & Seers, 2003). These qualitative studies report that there are three forms of knowle dge required for optimal pain assessment and management: knowing the child, knowing the population, and knowi ng the science (Hunt et al., 2002). Carter et al. (2002) highlight issues im portant to caregivers of childre n with special needs regarding pain management. They report four emerging them es: learning to live with pain, dealing with uncertainty, expression of pain, and maki ng decisions. None of the parents had been taught

PAGE 62

62 about pain management in their children; they had to learn. Parents discussed the lack of information available and reinforced the need for individualized pain assessment tools. Information regarding the pain experience in a few other pop ulations is available, but scarce, and does not involve development of pain assessment tools. For example, there are reports of children with Downs syndrome having delayed processing of pain and a latent behavioral response to painful stimulusbut th ere is no pain assessmen t tool specifically developed for use in children with Downs syndrome (Hennequin, Morin, & Feine, 2000). As previously discussed in Chapter 1, there is on e study indicating that children with ASD have a significant facial response to painful stimuli, but their means of assessing the acute pain event involved utilizing an intricate a nd detailed facial coding schemeone that is impractical to use on a regular basis for pain assessm ent in ASD (Nader et al., 2004). Challenges to assessing pain in children with ASD involve the sometimes held perception that children with ASD cannot feel pain, and thus this research aimed to determine whether caregivers could assess pain in th eir children with ASD. From ther e, it can be determined what type of pain assessment tool would best benefit this population. This review of available pain assessment tools, and the examination of resear ch looking at pain assessment in vulnerable populations of children, highlights the importance of continued pain assessment research in these unique populations. It is apparent that pain e xpression in children with cognitive impairment, communication difficulties, developmental and neuromuscular disorders is somewhat variable. Several core pain expressive behaviors have been identified for th ese populations, however additional work is required to ensure that pain assessment is valid in each of the different groups of children. While children with ASD might exhi bit several of the already identified pain expressive behaviors, close exam ination of this population is warra nted. The available literature

PAGE 63

63 provides a foundation from which additional research into pain assessment in children with ASD may stem. Ethical Considerations This next discussion illum inates several ethi cal issues specifica lly relevant to the conducted research. It brie fly presents the ethical principles pertinent to these issues, and describes measures taken to minimize risk to study participants. The first issue relates to the fact that this research involved vulnerable populations (childre n, children with developmental disabilities, and caregivers of children with developmental disabili ties). The second issue relates to the nature of the research question which involved the study of pain. Vulnerable Populations Autonom y refers to recognizing an individual s capacities and perspective, including his or her right to hold certain view s, to make certain choices, and to take certain actions based on personal values and beliefs (Beauchamp & Walters 1999, p. 19). In an effort to preserve a participants autonomy, most rese arch involving human subjects requires that the participants provide informed consent. The ability to give in formed consent requires that a) participants be given all information regarding th eir participation, b) pa rticipants realize th eir participation is voluntary, c) participants understand all the information given to them, and d) participants have the capacity for decision-making (Ascension Healt h, 2007). Special consider ations were made to ensure these requirements in the conducted studies While the first stages of this research involved primarily the caregivers of children with ASD, future studies might involve more active participation by the children themselves, and thus i ssues pertinent to these future studies are also reviewed in this section. Whenever possible, children need to be in cluded in the informed consent process (American Academy of Pediatrics [AAP], 1995; Helseth & Slettebo, 20 04). Legally, minors

PAGE 64

64 cannot enter into a contract, and thus they requ ire parental proxy. Id eally, even though minors cannot give consent, it is useful to obtain assent Assent is the moral re quirement to acquire the closest approximation of consent one can achieve within the childs capacity to understand (Helseth & Slettebo, 2004, p. 302). Research involving children w ith ASD poses an additional challenge to assent when one considers the li mited communication abiliti es of the population. Because ASD is a heterogeneous disorder, some children may be more capable of understanding their role in participation than ot hers. It is important to work w ith parents to ensure that their proxy consent is informed, and that if it is possi ble to obtain assent, this is done. The first study conducted in this research utilized surveys, which were filled out solely by caregivers. An informational letter was presented with the survey, describing the voluntary nature of filling out the form and returning it. According to the Inst itutional Review Board (IRB) at the University of Florida, consent may be implied if the caregiver fills out the form and then voluntarily sends it back. The requirement for documentation of informed consent may be waived (University of Florida Institutional Review Board, 2003/2004) and was approved for this research. Working with caregivers of children with ASD was also a unique situatio n. Parents of children with developmental disabilities need to know that their particip ation in research is completely voluntary, and that the care of thei r child in no way depends on participation in studies. If there is any sense that they must participate in order to receive quality care for their child, ethical principles involving ju stice may be violated. There ar e several principles of justice which are typically contextual ized when discussed (Beauchamp & Walters, 2003). Beauchamp and Walters (1999) point out the minimal, beginni ng principle as being concerned with ensuring that like cases should be treated alike, or, to use the language of equality, equals ought to be treated equally and unequals unequally (p. 22). Research with parents of vulnerable children

PAGE 65

65 requires that when recruited, these parents are ensu red that the care of their child does not change with or without their participation. Util ization of institutional re view boards can help the researcher examine the process by which participants (parents and their children) are protected. The Study of Pain When working in fields involvi ng the clinical treatm ent and research of pain, there is an ethical im petus to relieve pain. Hadjistavropoul os (2004) points out that regardless of ones ethical perspective, ensuring that vulnerable popul ations have access to adequate pain assessment and management is not usually a controversial issue. Walco, Burns, and Cassidy (2003) point out that numerous papers assert that the alleviatio n of pain is an ethical imperative in nursing and medicine. According to Ferrell and colleagues (2001), the undertreatment of pain in vulnerable populations (children, cognitively impaired indivi duals, elderly), is a top ethical concern among physicians and psychologists who manage pain. The ethical principle of beneficence, and its relationship to nonmaleficence is pertinent to examining the phe nomenon of pain. According to Beauchamp and Walters (2003), beneficence is a complex principle, involving ones obligation to 1) actively promote good, 2) prevent evil or ha rm, 3) remove evil or harm and 4) do no harm (nonmaleficence). In an attempt to ensure that children with communicative and social impairments are not experiencing unrelieved pain, this research could be considered an ethical imperative. The studies conducted did not involve purposefully inflicting pain upon participants, and because of the vulnerability of this populat ion, this would never be an ac ceptable research method. Any examination of children in pain would have to oc cur in a natural setting, whereby the child might be in pain from some everyday occurrence, or perh aps because of a necessary medical procedure. Similar to pain research in the elderly with dementia, prescribed protocols ensuring that no unnecessary harm is inflicted on participants will n eed to be developed. Effective forms of pain

PAGE 66

66 relief must be provided if pain is detected at any time (Hadjistavropoulos, 2004). There are current ethical codes available to guide research in the domain of pain, published by a variety of regulatory organizations, and se veral organized groups focuse d on the study of painthe American Pain Society [APS], for example. This research was guided by ethical codes, and all research involving parents and children underwent review by the IRB, whose sole purpose is to protect research participants. Rationale and Need for Instrument Development The literature does not report th e exis tence of a valid, reliab le instrument to assess for and subsequently measure and managepain in children on the autism spectrum. Any attempt to utilize an existing tool, or adapt a tool for this population is confounded by the considerable confusion surrounding whether children with autism ar e even capable of feeling pain. It is not known what specific parts of the pain process might be impaired or influenced by their inherent limitations. Because of the confusion that exis ts regarding how children with ASD experience pain, it was inappropriate to attempt to design an assessment tool without a better understanding of the phenomenon at hand. The studies conducted in this research were necessary in order to determine whether it is appropriate to continue instrument development. They a) explored caregiver perspectives regarding pain expression in children with ASD, b) generated a number of potential pain expressive behavi ors appropriate for an initial item pool, and c) reduced the initial list of behaviors to a subset of items that can now be used to further develop a tool for assessing pain in this population. Summary A review of autism (its prevalence, theo retical positions rega rding etiology, and description of core features asso ciated with the disorder) prepares the reader to consider how pain expression might be different in this population. Additionally, a focused theoretical

PAGE 67

67 discussion on the nature of communica tion, communication development, and the communication impairments specific to autism allows one to realize that se lf-report of pain is limited in this population. Detailed examination of work that has been done to examine pain expression in similar and related populations of children provides an understanding of the foundation from which this current research ex tends. Finally, disc ussion of the ethical implications related to a) working with vulnera ble populations, and b) the study of pain, ensures the reader that this Investigator minimized risk to study participants when conducting this research. This review describes pain assessment t ools available for children with cognitive impairment, children with neuromuscular disord ers (i.e., CP), and children with communication impairment. These assessment tools provide valu able insight into how families and healthcare providers assess and evaluate pain in unique ch ildren. None of the aforementioned instruments however, focus solely on children with autism spectrum disorder. While children with ASD do have limitations in communication, the brea dth of their limitations extends beyond communication, to include the social and behavioral impairments previously de scribed in detail. It is inappropriate to use existing instru ments to assess pain in this population. Furthermore, several of the indicators included in the more recently developed instruments for children with communication impairment may not be applicable to children with autism (i.e., seeking comfort or physical closen ess). If one watches for thes e specific indicators, and does not see them, it may be wrongly assumed that a ch ild with ASD is pain free. This review highlights the theoretical uniquene ss of the pain experi ence in ASD, and suppor ts the premise of this research: that it was necessary to develop a pa in assessment tool specifically for use in this population.

PAGE 68

68 CHAPTER 3 METHODS AND PROCEDURES The purpose of this research was to explor e how child ren with autism spectrum disorder (ASD) express pain, and to begin development of a pain assessment tool for use with this population. A series of two studi es were conducted to a) descri be how caregivers of children with ASD determine when their children are in pain, b) understand what experts believe about pain expressive behaviors in children with ASD, and c) establish the content validity of a set of pain expressive indicators that may be used to assess pain in children with ASD. Instrument Development DeVellis (2 003) articulates eight steps nece ssary to develop a psychometrically sound instrument. They include a) determine what is to be measured, b) generate an item pool, c) determine the format for measurement, d) have th e initial pool reviewed by experts, e) consider the inclusion of validation items, f) administer items to a development sample, g) evaluate the items, and h) optimize the scale length. M easurement experts (Allen & Yen, 1979; Crocker & Algina, 1986; Portney & Watkins, 2000) emphasize the extreme importance of the initial steps in instrument development. This research aimed to complete the first four steps in developing a pain assessment tool for use in ASD. These st eps are critical for future research, which will continue the development and testing of a pain assessment tool for use in this population. Thoughtfulness early in the development process ensures that an optimally valid instrument results. Study 1: Caregiver Perspectives of the Pain Experience in ASD The first study conducted for this research was titled Understanding the P ain Experience in Children with Autism: Caregiver Perspectives and asked caregivers to provide information

PAGE 69

69 about how they determine when their children wi th ASD are in pain. From this point on, this first study will be referred to as Study 1 and the second study will be referred to as Study 2. Purpose The purpose of this exploratory descript ive s tudy was to characterize caregiver perspectives and concerns regardi ng pain in their children with au tism, and to begin to identify pain expressive indicators and behaviors unique to children with ASD. This was achieved by examining caregiver responses to a mailed surv ey and by conducting semi-structured interviews with a random subset of caregivers. The resul ting descriptive data provided insight into how children on the autism spectrum experience a nd communicate pain to the world around them. Study Design This two-phase study was approved by the Univ ersity of Florida H ealth Science Center, Institutional Review Board (IRB). During Phase I, a survey was developed by the author and m ailed to four hundred families of children with a diagnosed autism spectrum disorder. During Phase II, ten caregivers participated in a semi-str uctured phone interview in order to discuss their childs pain expression in more detail. Participants: Recruitment, Consent, and Anonymity Participants included caregivers of children with a diagnosis of autism PDD-NOS, or Aspergers disorder (AD). All caregivers were identified as primary caregivers, living in the home with their child with ASD, and all were ab le to write and speak in English. Surveys were distributed, by mail, to 400 caregivers whose children utilized se rvices and resources provided by the Center for Autism and Related Disabilities (CARD) at the University of Florida. Response was voluntary. A detailed cover letter provided information regarding the study aims and caregiver rights as participants (see A ppendix A). This study was conducted with IRB

PAGE 70

70 permission to waive documentation of informed consent, und er the assumption that by voluntarily responding, it could be safely assumed that participan ts implied their consent. Interested caregivers anonymously responded by completing the mailed survey and returning it (also by mail) in a pre-addressed pre-stamped envelope, which had been included with the survey. Caregivers were given the option to provide their first name and telephone number, if they were interested in participating in the semi-structured interview via a follow up phone call. A subset of caregivers were randomly selected, and then invited to participate in Phase II. Telephone interviews were then c onducted. Caregiver responses and thoughts were hand-written as the interview was conducted, and then typed by the primary investigator. All surveys and response sheets were de-identified prior to analysis. Measures/Instruments Two instrum ents were developed for this e xploratory descriptive study, the Caregiver Survey on Pain Expression in Children with ASD and the Semi-Structured Interview Guide to Discuss Pain in ASD (see Table 3-1). Caregiver Survey on pain expressio n in children with ASD The Caregiver Survey was developed in orde r to elicit perceptions caregivers have regarding their ch ilds pain expression. In addition to basic demographic information, participants were asked three yes or no que stions, and were prompted to provide additional descriptive information re garding their child. Semi-structured interview guide to discuss pain in ASD Al most 80% of survey respondents provided a first name and phone number in order to receive a follow-up call. A random set of ten caregivers were calle d to conduct the semistructured interview. The interview involved asking ten ope n-ended questions with each

PAGE 71

71 participant. Caregivers were allowed to elaborate on those issues that they felt were most important and concerning to them. Data Synthesis and Analysis Caregiver survey responses were com piled. Answers to yes or no questions were quantified, and descriptive information was examined to identify common themes and issues. All pain expressive indicators (or behaviors) described by caregivers were noted, and used to generate a growing list of potential pain indicator s in this population. This list of items was utilized in Study 2 in order to de termine whether it is possible to develop a pain assessment tool for use in this population. Caregiver challenges re garding pain assessment in their children were noted. Details from the semi-structured interviews were used to better qualify the beliefs and perspectives held by caregivers re garding pain expression in their children. Several case studies were drafted to inform others about pa in expression in children with ASD. Study 2: Expert Appraisal of Potential Pa in Expressive Indicators in ASD The second study conducted in this research was titled Expert-Rated Relevancy of Potential Pain Expressive Indica tors in ASD: Establishing Conten t Validity. From this point on, this second study will be referred to as Study 2. Purpose The purpose of this study was to identify a co re set of indicators relevant to pain assessm ent in ASD. This was accomplished by a) generating a comprehensive list of potential pain expressive indicators in children with ASD, b) having this list reviewed by autism experts, and c) establishing the content validity of each ite m in order to reduce the list to a number of items achieving an acceptable scale-level content validity.

PAGE 72

72 Participants: Expert Reviewers Fifteen experts were invited to participate in this study. Expert s were identified first by the investigator, and then discussed with a seas oned autism expertwhose role was to further examine and validate the background and experience of the identified experts. Experts needed to be currently working with children diagnosed with ASD. They needed to have a history of ongoing clinical and/or research projects in the fields of auti sm and/or pain assessment in vulnerable populations of children. Of the fifteen e xperts invited to participate, it was estimated that between six and nine would be able to review the list of poten tial pain indicators, which is the number necessary to establish content validity for individual items and the resulting scale. Measures/Instruments: Item List for Expert Review It is universally recommended that a larg e item pool be generated when developing instruments, in order to allow an investigator to include all possible items tapping into a construct, and thus devise a psychometrically stro ng instrument. The definition of large varies from one and a half times as large as the anticipate d final scale (Allen & Yen, 1979) to three or four times as large as the final version (DeVellis, 2003). Current pain assessment tools for use in specialized populations, such as the Non-Communicating Childrens Pain Checklist, are about 30 items long. Preliminary reports indicate that this tool with 30 items is easy to use by caregivers, takes little time, and accurately discriminates pain in populations in which it has been validated (Breau, Finley, McGrath, & Camf ield, 2002; Breau, McGrath, Camf ield, & Finley, 2002). Given that, theoretically, several of th e items in this already develope d tool might be appropriate for children with ASD, while other items may need to be removed, or replaced, it was anticipated that the final version of the t ool in development might be between 20 and 30 items. Review of the pain and autism literature, examination of other observational pain assessment tools,

PAGE 73

73 caregiver surveys and interviews from Study 1, and prelim inary discussions with autism expertsnone of whom participated in Study 2generated 77 initial items. An item list was developed that cons isted of these 77 behaviors that might indicate pain in children with ASD (see Appendix B). This total number of initial items was appropriate, given the recommendations that the item pool be some where between one and a half (45) and four times (120) larger than the anticipated final instrument. These behaviors were put into 6 categories: Vocal/Verbal Indicators, Physio logical Indicators, Activity/Movement, Behavioral Indicators, Daily Activities, and Facial Indicators. Procedures and Data Analysis An initial iteration of the content validity pr ocess was conducted with experts in the fields of autism and pain to closely examine the curre nt item pool. Items were revised, removed, or retained based on expert input regarding the re ported relevance to pain assessment in children with ASD. Establishing content validity Measurem ent experts emphasize the importance of establishing content validity. Content validity represents the degree to which elements of an assessment instrument are relevant to and representative of the targeted construct for a particular assess ment purpose (Haynes, Richard, & Kubany, 1995, p. 238). Throughout the literature, researchers co mmonly report that content validity was established, however the process by which content validity was established is not always articulated. It is impor tant to point out that establ ishing content validity is a process. As articulated by Polit, Beck and Owen (2007), it ma y be necessary to undergo several iterations of item review, especially if the first review reveal s that a number of item revisions, clarifications, or additions are warranted. This research aime d to complete the first iteration of item review, and implications for a second round with experts are discussed in Chapter 5.

PAGE 74

74 Before beginning this study, various methods for establishing content validity were examined. The process for establishing content validity has been described in several nursing texts, and is further outlined in a number of articles (Polit & Beck, 2006; Polit, Beck, & Owen, 2007). One of the commonly reported quantitative measures of content validity is the content validity index (CVI). Lynn (1986; as cited in Polit & Beck, 2006) recommends that between three and ten experts participate in the content va lidity process. Each ex pert rates every item on a 4-point ordinal scale labeled: 1 ( not relevant ), 2 ( somewhat relevant ), 3 ( quite relevant ), and 4 ( highly relevant ). Following review by all experts, an item-level CVI (I-CVI) is calculated for each item. For this study, a cover letter desc ribing the research accompanied the item list (see Appendix C) and instructed the reviewers to rate each of the 77 items as either not relevant, somewhat relevant, quite releva nt, or highly relevant to pain assessment in children with ASD. Item-level content validity indexes (I-CVI) I-CVI is calculated by figuring the num ber of experts giving a rating of either three or fourdivided by the total number of experts (Polit & Beck, 2006). To accommodate for chance agreement, Lynn (1986; as ci ted in Polit & Beck, 2006) advocat es that if there are five or fewer judges, the I-CVI should be 1.00 in order to retain an item as relevant. For six or more judges, she recommends an I-CVI of .78 or above. Others have calculated the I-CVI with five judges and accepted any item with an I-CVI abov e .80 (Decker & Perry, 2003). Polit, Beck, & Owen (2007) state that because establishing content validity may require several expert reviews, in the initial iteration it is wise to retain it ems with an I-CVI of .78 or above, however it may be acceptable to consider items with an I-CVI some what lower than .78 as candidates for revision rather than discard them too hurriedly. L ynns (1986) methods are most commonly reported throughout the nursing literature, and have b een adopted by many researchers embarking on

PAGE 75

75 instrument development. Her methods are sometimes critiqued because they do not statistically take into account the possibility for chance ag reement (Wynd, Schmidt, & Schaefer, 2003). It is pointed out that other indica tors are available to calculate interrater agreement (kappa, for example), and do account for chance agreement (Polit, Beck, & Owen, 2007; Wynd, Schmidt, & Schaefer, 2003). Supporters of the CVI counter argue that kappa accounts for chance agreement and chance disagreement. Kappa also does not provide information at the item-levelw hich is often necessary when examining each items relevan ce (or irrelevance) to a particular assessment tool. I-CVIs provide information that decision-makers need in order to construct an assessment scale. Polit, Beck, and Owen (2007) argue that the CVI is appropriate for item-level analysis, and to address the debate regarding chance agreement, they calculated a modified kappa statistic (taking into consid eration both chance agreement and the proportion of expert agreement on relevance) to allow an investigator to compare each calculated I-CVI with what would translate into an excellent, good, or fair modified kappa coefficient. To articulate excellent, good, or fair, interr ater agreement, they utilize th e kappa coefficient criteria set by Cicchetti and Sparrow (1981). In a sense, thei r calculations indicate that items with high ICVIs often have adequate modified kappa coeffi cients, therefore indicating that the I-CVI is useful even with the described limitations regarding chance ag reement (and disagreement). This current research utilized the table developed by Polit et al. (2007) to determine whether all calculated I-CV Is were excellent, good, or fai r in relation to their modified kappa. For this study, it was establ ished a priori that six experts would participate in the initial expert review, and a cut-off of .78 would be utilized to determine whether items should be

PAGE 76

76 retained. Items with an I-CVI just below .78 w ould be considered for revision, and those with the lowest I-CVIs would be removed from the list. Scale-level content validity index Despite use of the I-CVI to inform scale deve lopers whether to dis card or retain items, many published articles describing various scales development only report the scale-level CVI (S-CVI). Because there are several ways to compute the S-CVI, it is important for authors to provide information on how the S-CVI was com puted (Polit & Beck, 2006). Polit and Beck (2006) recommend calculating the S-CVI by reporting the average of all the I-CVIs in a final scale. For example, a scale with five items, whose I-CVIs are 1.0, 1.0, 1.0, .83, and .83, would have a calculated S-CVI of (1+1+1+.83+.83)/5 = .93. This calculation is referred to as the SCVI/Ave by Polit & Beck (2006). There is deba te regarding whether the acceptable S-CVI should be set at .80 or .90 (Polit & Beck, 2006). This initial item review with experts reveal ed that it was possible to remove some items, retain some items, and that there were some items that needed to be revised. As previously discussed, Polit, Beck, and Owen (2007) point out that it may be necessary to undergo multiple iterations in an effort to establish content valid ity. Because the initial list of items needed revision, an S-CVI was not yet ca lculated. If it is determin ed, following another review by experts, that item revision is no longer necessa ry; the S-CVI/Ave will be calculated according to specifications outlined by Polit and Beck (2006). An a priori determination will be made to accept .80 as an acceptable scal e-level content validity. Content validity procedures guarantee that the theoretical conceptualization of the investigator is supported by those co nsidered to be experts in the fi eld. This process ensures that items remaining in the tool following these co ntent validity procedures are a) supported

PAGE 77

77 theoretically by the lite rature, b) supported by qualitative and/or quantitative study findings and/or clinical experience, and c) have systematically undergone expert review. Expert comments and suggestions Expert suggestions, questions and comments were solicited following completion of the item s list review. Experts were given the opport unity to comment on specific items, or perhaps to discuss the overall pro cess of this instruments development. Many researchers embarking on instrument development underutilize the expert a dvice that is available (Grant & Davis, 1997). Careful thought was given in order to select e xperts that would be inte rested in the current research, so that their advice a nd expertise would be readily available throughout the process. Expert comments and suggestions resulting fr om the item review have been thoughtfully considered and are reported in Chapter 5. The imp lications of their thoughts on this instruments further development will also be discussed. Summary The m ethods presented here describe an initia l attempt to think about the long-term nature of understanding how to assess pain in children with ASD. It is the intent of this discussion to ensure readers that the writer is adequately famili ar with the various issues related to instrument developmentdesigning studies that will ensu re the development of psychometrically sound instruments, understanding reliab ility and validity, and how to es tablish such measures, etc. Thoughtful preparation for every step in the proc ess of instrument development, including the two studies conducted for this research, ensure s the development of a psychometrically sound tool for assessing pain in childre n with autism spectrum disorder.

PAGE 78

78 Table 3-1. Study 1: Caregiver survey and semi-structured interview questions Caregiver survey Semi-structured interview guide Compared to other children your childs age, do you feel your child responds differently to painful events? Please describe. Do you find it difficult to tell when your child might be in pain? Please describe. Do you feel healthcare providers are able to assess and treat your childs pain well? Please describe. Compared to other ch ildren your childs age, describe your general impression regarding how your child responds to painful events. Describe a specific time, if any, when your childs response to pain appeared unusual or different from other children. How do you determine if your child is in pain? What type of comfort measures might you use to help your child when he/she is in pain? Describe how your child communicates with you. How do you usually determine what your child wants or needs? Describe a time, if any, when your child got unusually upset or irritated by specific sounds, smells, or touch. Does your child ever deliberately injure himself/herself, for example by biting him/herself, or banging his/her head? Discuss the behaviors. Compared to other children your childs age, describe the range of facial expressions they display. Do you feel your childs pain is adequately managed by healthcare providers? If not, what improvements could be made?

PAGE 79

79 CHAPTER 4 RESULTS The findings from two studies are presented in this chapter. First presented are results from Study 1, including demographic informa tion, and quantitative data for each question. Then, descriptive information provided by car egiversfrom surveys and semi-structured interviewsis presented. Next, results of Stud y 2 are described, beginning with item-level analysis. Items achieving acceptable content validity are presented. Those items not achieving an I-CVI of .78 are also discussed. Thoughts and comments provided by expert reviewers are reported, and anticipated item list revisions are introduced, but are more thoroughly discussed in Chapter 5. Study 1: Caregiver Survey Results Eighty-eight surveys were com pleted by caregiv ers of children with ASD and returned by mail. All surveys were included in data analysis. This is equivalent to a return rate of 22%. Given this low response rate, it is important to consider how a high nonresponse rate might influence findings and subsequent conclusions. This is discussed further in the Limitations section of Chapter 5. Demographic Information Caregivers reported that their children had a diagnosis of either autism (n = 32), PDD-NOS (n = 19), Aspergers disorder (n = 12) or likely autism (n = 25). For the purposes of this study, a category likely autistic was used because so me children exhibited enough autistic behaviors to receive services from the Center for Autism and Related Disabilities, but the childs official ASD diagnosis may not have been conclusive ly established at the time the survey was completed. A majority of the children described in Study 1 were autistic or likely autistic (n = 57). The population of children described by care givers consisted of 62 boys, 20 girls, and 6

PAGE 80

80 children whose gender was not reported. These numbers reflect re ported trends that ASD occurs three times more often in boys than girls. For this sample, the male female ratio was 3.3:1 (62 boys, 19 girls). Quantitative Results from Caregiver Surveys Table 4-1 summarizes the quantitative responses to the three survey questions. Eighty-six percen t (n = 76) of caregivers felt their child resp onded differently to pai n. Seventy percent (n = 62) stated they find it difficult to determine when their child might be in pain, and fifty-six caregivers (64%) respon ded that healthcare providers ei ther did notor only sometimes adequately assessed and treated their childs pain. Descriptive Information Provided by Caregivers Question 1 : Compared to other children your childs age, do you feel your child responds differently to painfu l events? Please describe Written caregiver responses provided descriptive information regarding pa in expression in children with ASD. The responses to Question 1 were examined, and themes were identified by the author and an autism expert. Themes common to those caregivers who do feel their child responds differently to pain are reported. These themes highlight the mo st commonly reported differences articulated by caregivers, and were identified by looking at ho w frequently each issues was mentioned. The themes, along with a description/definition of each, are summarized in Table 4-2, and include exhibits altered sensitivity to pain, displays unusual/unique pain expression, demonstrates pain seeking behavior, pain expression varies by type, and pain expression varies with development. The theme, exhibits altered sensitivity to pai n, refers to a variety of caregiver reports describing either hyper-sensitivit y or hypo-sensitivity to pain. Several caregiver quotations illuminating this commonly reported phenomenon are presented in Table 4-3. The theme,

PAGE 81

81 displays unusual/unique pain e xpression, refers to those res ponses where caregivers correlate specific behaviors and/or indicators to pain in their children. They openly acknowledged that these reported pain indicators are not typically associated with pain in children. Finally, examples of caregiver quotes from which the themes demonstrates pa in seeking behavior, pain expression varies by type, and pain expression changes w ith development were derived are also provided in Table 4-3. Question 2: Do you find it difficult to tell when your child might be in pain? Please Describe. Caregivers were asked whether they had difficulty determining when their child might be in pain. Seventy percent (n = 62) stated they find it difficult to determine when their child might be in pain. Written descriptions (n = 39, 44%) of the difficulties associated with pain assessment primarily reflected chal lenges related to working with nonverbal children (and thus children who do not verbally complain). Othe r caregivers (n = 27, 31%) reported that because their children do not cry, or because they appear stoic, it is difficult to determine if they are in pain. The thirty percent (n = 26) of caregivers reporting that it is not difficult to determine when their children are in pain stated that their childre n were verbal (n = 10), or they could identify specific pain expressive behavior s unique to their child. These reported behaviors are listed in Table 4-4, and were referenced when generati ng the comprehensive list of potential pain expressive behaviors for review in Study 2. Ot her caregivers (n = 4) stated they can tell when something is wrong, but get frustrated when thei r child cannot help them determine where or how serious the pain is. Question 3: Do you feel health care providers are able to assess and treat your childs pain well? Please describe. Fifty-six caregivers (64%) reported that healthcare

PAGE 82

82 providers either did not, or onl y sometimes, adequately assessed and treated their childs pain. Written responses highlighted that many parents believe pain is an indicator that something is wrong in the body. Because they have a difficult tim e determining when their child is in pain, they are forced to depend on other signals (i.e., fever, gait disturbances ) to alert them that something might be physically wrong. The prevalent caregiver concerns involved their ability, as caregivers, to advocate for their children. They reported not bei ng taken seriously at healthcare facilities when they knew something was wrong, but their child was not exhibiting any typical pain expressive behavi ors. A number of parents reported that they have worked hard to find primary care physicians who understand ASD, and who will advocate for them and their children within the healthcare system. Study 2: Expert-Rated Relevance o f Potential Pain Indicators Information gleaned from Study 1 characterized caregiver perceptions regarding the pain experience in children with ASD, and highlight ed challenges associated with attempting to assess pain in children with so cial and communicative impairment s. Caregiver-identified pain indicators were added to a growing list of expr essive/observable behavi ors that might indicate pain in children with ASD. In Study 2, this list was reviewed by autism and pain experts in order to a) gain additional insight into pain expression in children with ASD, and b) identify behaviors considered highly relevant to pain assessment in ASD Examination of Item-Level Conten t Validity Indexes An item-level content validity index (I-CV I) was computed for each of the 77 items reviewed by the expert panel. I-CVIs ranged from 0 (where not one expert believed the item was either quite or highly relevant, to 1.0 (whe re ALL experts believed the item was quite or highly relevant to pain assessment in ASD. The calculated I-CVI for each item is displayed in Table 4-5. In summary: 4 items had an I-CVI of 0, 13 items had an I-CVI of .17, 13 items had

PAGE 83

83 an I-CVI of .33, 14 items had an I-CVI of .5, 19 items had an I-CVI of .67, 13 items had an ICVI of .83, and 1 item had an I-CVI of 1.0. For this study, it was established a priori that six experts would par ticipate in the expert review, and an I-CVI cut-off of .78 would be utilized to determine whether items should be retained, revised, or removed from the list. Using these guidelines, 14 items achieved an I-CVI greater than .78. These items are referred to as the Primary Pain Indicators and achieved a high enough I-CVI to remain in the developing pain assessment tool. These items include: rocking unusually, lashing/striking out being less active, bangi ng his/her head, injuring oneself, crankiness (being more cranky than usual), lying ar ound/acting lethargic, increased heart rate, furrowing brow, s creaming/yelling/throwing tantrums, guarding (protecting) or favoring a part icular part of the body when moving, inconsolability (being unable to console), tensing face, and grimaci ng. Five of these items were originally categorized as Activity/Movement pain indicator s. Three items were from the Behavioral category, three from the Facial category, one from Vocal/Verbal, one from Daily Activities, and one from Physio logical. This highlights that experts considered a range of indictors to be relevant to pain assessment, from each of the aforementioned categories. As recommended by Polit, Beck, and Owen (2007) the group of indicators that achieved an I-CVI of .67 (just below the pre-established ICVI = .78) were not completely removed at this point in the instruments development, and will be considered for revision. They are referred to as the Secondary Pain Indicators (n = 19), a nd the implications of revising, removing, or retaining each of these items are discussed in Chapter 5. These items include: acting off according to caregiver, not acting like him/her self, crying, moaning, whining, whimpering (softly), stating/repeating a specific pain-relat ed word, seeking comfort or physical touch,

PAGE 84

84 touching rubbing, picking and/or tapping a specific part of the body, changing color (flushing/redness), produc ing tears (without overt crying or vo calizations), increased rate of breathing, sleeping less, gri nding teeth, clenching jaw do wn, frowning, turning down mouth, pouting, quivering, puckering lips, widening eyes, becoming more aggressive (hitting, pinching, biting others, acting angry, and holding his/ her head for prolonged periods of time. Calculation of a Scale-Level Content Validity Index Because th is expert review resulted in the n eed to revise itemsand perhaps re-categorize the items rated most relevant to pain assessment in ASDthe final form of this instrument was not yet realized. It was also ther efore, not appropriate to calculat e the S-CVI at this point in the instruments development. This decision is a ddressed again in the Chapter 5. Once a set of relevant items are finalizedand prior to additional administration of the instrument to the sample populationthe S-CVI will be calculated. Expert Comments and Suggestions Expert com ments are briefly mentioned here, and the implications of these thoughts and suggestions are discussed in Ch apter 5. Comments generally in cluded a) suggestions regarding how to re-word particular items, b) requests th at better/additional operational definitions for particular items be provided, c) suggestions on how to more clearl y categorize the relevant pain indicators, d) information on how they (the particular expert) rate d whether items were considered relevant or not, and e) suggestions for the next steps in this instruments development. Summary These results highlight the perceptions held by caregivers regarding the pain experience in children with ASD. The ir insights regarding th e indicators they use to determine when their

PAGE 85

85 children are in pain demonstrate the unique nature of pain expression in this population. These indicators were added to the list of potential pain i ndicators that had been already derived from the pain and autism literature. Finally, expert review of the entire list identified key pain expressive behaviors that will be used in the further development of an instrument to assess pain in children with ASD.

PAGE 86

86 Table 4-1. Study 1: Quantitative results from caregiver surveys Question Yes No Sometimes Dont know Compared to other child ren your childs age, do you feel your child responds differently to painful events? 76 (86%)12 (14%)0 0 Do you find it difficult to determine when your child is in pain? 62 (70%)26 (30%)0 0 Do you feel healthcare providers are able to assess and treat your childs pain well? 19 (22%)40 (45%)16 (18%) 13 (15%) Note: n=88

PAGE 87

87Table 4-2. Caregiver survey (question 1) results: Identification and description of frequently reported themes Identified themes Detailed description/definition Exhibits altered se nsitivity to pain: Hyper-sensitive to pain Hypo-sensitive to pain/has a high tolerance for pain Hyper-hypo-se nsitive phenomenon Child exhibits exaggerated response to minimal or seemingly non-painful events Child exhibits a minimal or lack of response to seemingly painful event Child oscillates between over-reacting and under-reacting to seemingly painful events Displays unusual/unique pain expression Child demonstrates delayed response to pain, or exhibits unusual/atypical pain expressive behaviors as identified by caregiver (i.e., laughing) Demonstrates pain seeking behavior Child engages in self-injurious behavior or seeks out painful Stimuli Pain expression varies by type Child reacts differently to various types (acute vs. chronic) or degrees of pain Pain expression changes with development As children grow and develop, pain expr ession and the ability to communicate pain changes

PAGE 88

88Table 4-3. Caregiver survey (quest ion 1) results: Identified themes and sample caregiver quotations Caregiver quote Identified theme Benjamin* is very demonstrative he seems to feel things more intensely. He has extreme dramatic reactions to unexpected pain. Loud screaming and tantrums. It takes some time to calm him down. He makes a big thing about somethi ng small, like cutting his finger a little bit. Exhibits altered sensitivit y to pain: Hyper-sensitivity It takes a while for her to feel pa in. Sometimes has no painshe can get hit or bump into things and not realize she is hurt or bleeding. My child only responds to severe pa in and then he only rubs the place that has been injured and briefly fusses. Most times he doesnt even acknowledge his injuries. Exhibits altered sensitivity to pain: Hypo-sensitivity or high tolerance for pain A light touch will sometimes cause a painful reaction. Whereas, a deeper touch will not. Minor pa ins will cause crying. More moderate to severe pains will sometimes cause laughter! My daughter will either overreact or show no signs that it was painfulfor example I noticed sh e had half of one toenail gonebut she never reacted to it at all Other times she will go on and on about something as small as a little scratch. Exhibits altered sens itivity to pain: (Hyper-hypo-sens itive phenomenon) Generally, my child does not compla in of minor pains. He will punch himself in the stomach and that i ndicates he is a little constipated. He doesnt talk. If he is in pain he might stomp his foot or clap his hands loud. Just sort of off and less active and cheerful. She will say odd things like it tickles. Often giggles instead of saying ouch. Displays unusual/unique pain expression

PAGE 89

89Table 4-3. Continued Caregiver quote Identified theme Jon* enjoys putting hands on hot things, such as light bulbs and oven burners. She will moan and bite her hand. He under and over reactsand he often seeks out ways to hurt himselfthrowing himself on the floor, biting his own arms. Demonstrates pain seeking behavior Blunt pain isnt as noticeable to hi m. However a splinter or scrape to the skin is very excessive in his expression. Yes to trauma types, i.e., needle pricksno to gas headaches, small cuts, blisters on his feet Pain expression varies by type When he was younger, he did not re spond to pain. For example, one day he had new shoes on all daya nd I didnt know they had the paper stuffed in them! Or hed bang his head and bite his hands. Now hes eight and can talk well, but now it seems he over-reacts to pain. The tiniest little thing gets him very upset. He reacts and seems to feel pain more now than when he was younger. He has improved greatly in his ability to recognize and describe painonly in the past two years has he been able to tell me he has a headache. Pain expression changes with development Note: indicates names have been changed.

PAGE 90

90Table 4-4. Pain indicators identifie d by caregivers of children with ASD Behavioral indicators Activit y/Movement Vocal/Verbal indi cators Changes in routine Lashes out/becomes aggressive His/her body language Changes Cries Lays around more Uses actions Bangs his/her head Screams/throws tantrums Sleeps more Stomps his foot Touches whatever hurts Gets quiet Something is just off Claps his hands loud Holds his/her head U tters/states a specific wo rd Is less cheerful Bites his hand Hunches over when walking Laughs Is less active Rocks violently Hurts himself Moans Is listless Hides Gets still He tells me Note: Indicators in quotation were taken directly from caregiver written responses. Indicators not in quotation were derived by the investigator to summarize concisely what several caregivers reported.

PAGE 91

91Table 4-5. Study 2: Calculated item-l evel content validity indexes (I-CV I)* for each item reviewed by experts I-CVI = 0 I-CVI = .17 I-CVI = .33 I-CVI = .5 I-CVI = .67 I-CVI = .83 I-CVI = 1.0 Humming/ singing Interacting more than normal with others Decreasing number and/or frequency of repetitive behaviors Sleeping more Sleeping less Lashing/striking out Rocking unusually Laughing Rolling eyes Sitting still Feeling cool or cold to touch Irritability (being more irritable than usual) Being less active Eating more than usual Raising eyebrows Stomping foot Lip biting Seeking comfort/ physical touch Banging his/her head Stating/ repeating a specific non pain word or phrase (i.e., bat, toe) Decreased rate of breathing Perseverating more on a particular item Fever Becoming more aggressive (i.e., hitting, pinching, biting others) Injuring oneself Seeming less sensitive to touch Making up stories or reenacting a painful circumstance Scratching a specific part of the body Acting angry Crankiness (being more cranky than usual) Becoming floppy, or goes limp Lip curling Interacting less than normal with others Widening eyes Laying around, acting lethargic Eating less, not interested in food Fidgeting, becoming more active, jumping around (motor restlessness) Isolating oneself more, hiding Frowning, turning down mouth Increased heart rate

PAGE 92

92Table 4-5. Continued I-CVI = 0 I-CVI = .17 I-CVI = .33 I-CVI = .5 I-CVI = .67 I-CVI = .83 I-CVI = 1.0 Holding breath Cooperating less than normal Loosing interest in things that are usually extremely important or interesting to child Pouting, quivering, puckering lips Furrowing brow Chewing, moving tongue around and/or out, smacking lips Facial restlessness, tics Increasing number and/or frequency of repetitive behaviors Producing tears (without overt crying or vocalizations) Screaming/ yelling/ throwing tantrums Babbling (saying something incomprehensible) Vocalizing less than normal, getting quiet Flaring nostrils Increased rate of breathing Guarding (protecting) or favoring a particular part of the body when moving Clapping hands loudly Seeming hypersensitive (overly sensitive) to touch Muscle tensing, rigidity Acting off according to caregiver; not acting like him/herself Inconsolability (being unable to console) Continuous eye blinking Shivering, Shaking Unhappiness Grinding teeth, clenching jaw down Tensing face Moving to, or staying in, a specific location or safe space Changing his/her usual body language Sweating, perspiring Squinching, squinting eyes Grimacing

PAGE 93

93 Table 4-5. Continued I-CVI = 0 I-CVI = .17 I-CVI = .33 I-CVI = .5 I-CVI = .67 I-CVI = .83 I-CVI = 1.0 Changing color (paleness) Crying (with or without tears) Moaning, whining, whimpering (softly) Changing color (flushing, redness) Touching, rubbing, picking, and/or tapping a specific part of the body Holding his/her head with both hands for prolonged periods of time Stating or repeating a specific pain -related word (i.e., hurt, ouch) Note: I-CVI was calculated by looking at th e proportion of expert reviewers rating an items relevancy as either quite or high. For example, if five of six experts rated an item as either quite or highly releva nt to pain assessment in ASD, the calcula ted I-CVI would be 5/6 = .83. All items in the I-CVI = .83 column had a calculated I-CVI of .83.

PAGE 94

94 CHAPTER 5 DISCUSSION This research explored pain expression in chil dren with autism spectrum disorder (ASD). These two studies add to what is known about how vulnerable pediatric populations specifically, those unable to accurately self-report painexpress their discomfort to those around them. This research focused on children with autism spectrum disorder, whose pain experience has hardly been investigated. The literature review conducted fo r this research revealed one empirical study examining pain in this populatio n (Nader et al., 2004). Nader et al. (2004) demonstrated that children with ASD reflexively (involuntarily) respond to painful stimuli, indicating that perhaps th e perceptions of pain insensitivity in this population are inaccurately founded. This dissertation resear ch extended those findings, to be tter describe what caregivers and autism expertspresumably, individuals w ho know this population bestbelieve about how these individuals experience and express pain. Finally, this re search facilitated the initial development of a pain assessment tool for use in this population, by identifying specific pain indicators relevant to children with ASD. Pain Expression in ASD Compared to Typically Developing Children Nader et al. (2004) reported th at a) caregivers of children with ASD m ight be confused about pain in their children, and that b) parent s perceive insensitivity to pain in their children when compared to nonimpaired children. Findings in this research are consistent with these reports. Caregivers stated that they do believe their children respond differently to pain when compared to other developing children. When as ked to qualify these differences, however, they did not always refer to their children as having a high tolerance for pai n, or insensitivity to pain. In this way, these fi ndings are new and unique, adding to what is known about how caregivers perceive the pain experience in their children.

PAGE 95

95 Several caregivers did refer to their childre n as having a minimal reaction to everyday painful occurrences; however a majority of caregivers desc ribed a phenomenon whereby their child would attend to various types of pain differently They described how a deep cut on the back of the childs head would cause minimal discomfort, but a tiny scratch on the hand would result in him or her being hyste rical. This phenomenon seems to be somewhat unique to this population. Bursch, Ingman, Vitti, Hyman, & Zeltz er (2004) posit that children with ASD may have intact acuity to sensor y input; however their processing of incoming information might be distorted. Thus rain might sound like gunfire, cl othing might feel like sandpaper, or fingers shampooing a scalp might feel like sharp meta l (p. 290). These sensory abnormalities have potential to distort the processing of pain stimuli as well, speaking to the fact that they feel the stimulus, but they may not attend to it as other children do. Thus, the reports by caregivers that their children seem hypersensitive to some pain, and then hyposensitive to other pain, might be explained by this overall abnormal sensory processing. This unusual responsiveness to the environm ent can be explained in part by stimulus overselectivity, the tendencyto respond to only a very limited amount of relevant sensory information (Bursch et al., 2004, p. 291). One car egiver described a situation where her child would grab a hot curling iron and not respond as if he were in pa in, but yet he would scream and yell in pain from the tag in his shirt. Sensory abnormalities are not seen in every child on the autism spectrum, but it may be that those child ren with sensory abnormalities processfocus on different aspects ofpain sensat ions differently. Additional i nvestigation into subgroups of children with ASD, for example those w ith sensory abnormalities, is warranted. Caregiver comments on how their children, when they did report pai n, would perseverate on the pain (or source of pain) al so highlight differences in the pain experience in this population

PAGE 96

96 compared to typically developing children. The pe rseverative tendencies unique to children with ASD permeate all types of experiences, including their pain experience. Bursch et al. (2004) stated that once focused on pain, difficulties in shifting attentional focus can serve to increase pain and associated distress (p. 294). Interrupt ing the perseveration then might lead to pain relief. Zeltzer and Schlank (2005) describe a situation in their pain clinic where a child with ASD presented to them yelling repeatedly, Ow! Ow! Ow! He had been shouting for the past two months, since sustaining a leg injury. Zeltzers immediate suggestio n that he squeeze a ball instead of shouting Ow! resulted in a transfer of his expression, and he actually reported feeling better because he was no longer embarrass ed about shouting Ow! all the time. While this particular persevera tive response was clearly asso ciated with pain (i.e., it is easy to infer the child was in some sort of pain because the word Ow! is typically associated with pain), one has to consider that other children may also engage in repetitive behaviors when in painhowever they may select (especially if they are unable to verbally communicate) other behaviors not typically associated with pain (i.e., rocking unus ually). These articulate d differences indicate that caregivers do not always believe their children are incapable of feeling pain. Determining When Children with ASD are in Pain Caregive rs reported that they find it difficult to determine when their children are in pain. Of those caregivers who can dete rmine when their children are in pain, many are frustrated because they can never figure out why, or where, or how bad it hurts. This inability to determine when children with ASD are in pain could be attributed to the abnormal sensory processing previously describedwhich confuses caregivers, because it often contributes to a minimal (or lack of) response to seemingly painful events. A lternatively, it could be related to what parents look for in trying to determine whether their children are in pain.

PAGE 97

97 Interestingly, a majority of the caregivers that stated their child doesnt feel pain, can handle pain more, or has a high tolerance for pain, alluded to how they make this inference. They mentioned that their child doesnt cry, doesnt say what is bothering him, is pain seeking, only cries a littl e, is nonverbal, or tells you in a calm manner that it really hurts mommy. One needs to examine what these ca regivers consider to be pain expressive behaviors in this popula tion. If caregivers are expecting their children to cry, or respond dramatically to pain, they may wrongly assume that their children have a high tolerance for pain, simply because they do not display these mo re typical pain expressive behaviors. Several caregivers acknowledged that their child ren experience pain differently, but they referred to this difference as being in the way they express their pain. They stated that they can determine when their child is in pain because he tells me, but tends to be quite stoic, he will punch himself in the stomach if it hurts, he wi ll lay around and sleep a lot, he will make up stories about getting away in a time machin e, or because he never communicates that something hurts, you have to pay close attention to behavioral cues. These caregivers have identified behaviors unique to their children that usually indicate they are in pain. One can see though, how some caregivers might interpret he will punch himself in the stomach as pain seeking, or having a high tolerance for painwhile other caregivers might identify that specific behavior as indicating pain in their particular child. Some caregivers also reported that they ha ve no trouble determining when their children are in pain because they are verbal, and can communicate when they are hurting. Comments regarding how they verbally communicate, however, indicate that those communication impairments typical of children with ASD permea te their ability to communicate pain. For example, they may be quite stoic, just scream just says several words and not express how

PAGE 98

98 he feels about it at all, simply repeat a phrase he has heard, or reenact a story. Children with reported high functioning autism will more often tell their caregivers when they are in pain. These findings warrant investigation into whet her there are differences in pain expression between children with ASD of different diagnose s (i.e., Aspergers disorder vs. PDD-NOS) and varying degrees of communicative ability. Pain assessment in this population heavily reli es on the perceptions and beliefs held by caregivers. This research aimed to illuminate so me of the perceptions and beliefs that might be contributing to confusion regarding whether ch ildren with ASD feel pain. Clearly, the communication impairments described previously influence how children with ASD express pain. The theoretical model guiding this res earch proposes a relationship between observer bias, and an observers ability to decode pa in expressive behavior s. If caregivers are watching for more typical pain expressive behaviors, their bias might cause them to inaccurately assume that their children are not in pain. This research demonstr ates that there is a relationship between these two variables, and begins to illuminate what that relationship might be like. These caregiver surveys indicated that while children with ASD mi ght respond to painful events differently, caregivers do believe their children are capable of feeling pain. This conclusion is congruent with the findings report ed by Nader et al. (2004) that children with autism should be viewed as being as reactive to pa inful stimuli as children without autism and do not support beliefs about pain insensitivity in children with autism (p. 96). Interestingly, these surveys indicate that sensory processing abnorma lities in some children with ASD, and the perseverative nature of the disorder likely cont ribute to the confusion (especially experienced by caregivers) surrounding the pain experience in ch ildren with ASD. Astute caregivers have identified specific pain indicators (often non-typi cal pain indicators) that are uniquely exhibited

PAGE 99

99 by their children. The second study conducted in this research aimed to investigate what autism experts believe about pain expression in ASD, and utilized the pain in dicators identified by caregivers to further explore whether development of a pain assessment tool specific to this population might be feasible. Communication and Social Impairme nts in ASD and Pai n Expression Findings from Study 1 and Study 2 further hi ghlight how the communication and social impairments seen in ASD might influence pain expression. Deficits in joint attention are theorized to impair a childs ability to develop social and communicative competencies. As previously described, joint attentional skills that children with ASD either lack (or have problems with) include referential looking, pointing and show ing, following ones gaze to look at an object with them, and visually following where others point. Tomasellos (2003) theory of language acquisition describes how understand ing the communicative intentions of others facilitates the emergence of language. The communication and soci al impairments in children with ASD affect the way they experience, and thus express, pain. Study 1 findings emphasize that those children with greater communicative competency do outwardly express their pain. Caregiver comments that their children are often stoic when they describe their pain, or that they will verbally communicate their pain by repeating a phrase like ants hurt you, demonstrate that despite verbal abilities, communicative deficits in pragmatic language use and echolalia influence pain expression. Children with Aspergers disorder might communicate their pain by using flat and emotionless speech, thus making it difficult to determine how severely they are hurting. Study 2 findings highlight that the pain experi ence in children with AS D might be more of an intrapersonal experience, rather than an interpersonal experience. This is consistent with the core social deficitsalso related to a lack of jo int attention skillsseen in children with ASD.

PAGE 100

100 Several expert-identified pain indicators that we re unique to children with ASD seem to reflect an intrapersonal experience, for example: r ocking unusually, injuring oneself, banging his/her head, laying around, actin g lethargic, and holding his/ her head with both hands. Several pain indicators helpful in assessing children with cognitive impairment and/or communicative impairments that were not considered relevant to ch ildren with ASD reflect an interpersonal experience. These include: disinterest in surroundings, an d less interaction with others, withdrawn. These findings support the postulated signi ficance of the social deficits seen in children with ASD to pain expression. The Communications Model of Pain proposed by Hadjistavropoulos and Craig (2002) posits that social and communicative competenci es influence the pain experience and pain expression. These research findings suppor t the models proposed relationships, and preliminarily demonstrate that the communication a nd social impairments specifically seen in the ASD population appear to uniquely influence pain expression. When determining how to assess pain in ASD, it will be important to continue to test the proposed model, and consider how social and communicative features commonly seen in this population affect their abili ty to express pain. The studies conducted in this research establis hed a foundation from whic h future studies may extend. Items Determined to be Relevan t to Pain Assessment in ASD The second study in this research examined 77 potential pain indicato rs in children with ASD and aimed to determine which indicators are most relevant to pain assessment in this population. Expert review incor porated into instrument develo pment ensures that items are added, removed, and revised, via an informed pr ocess. As previously mentioned, it is not uncommon for item lists utilized in instrument development to undergo several iterations of expert review, in order to ensure that the fina l set of items validly represent the construct of

PAGE 101

101 interest. This section presents the Primary Pain Indicators identified as being most relevant to pain assessment in this populat ion. Additionally, the subset of items that were considered relevant by a majority of the experts, howev er their calculated I-CVI fell below the preestablished cut-off (the Secondary Pain Indicators) are discussed. The Secondary Pain Indicators are evaluated, in light of this particular conten t validity process, and implications for leaving these items in the list for another expert review are presented. Finally, comments and suggestions provided by expe rts are reviewed. Primary Pain Indicators: Retained Items Fourteen item s had a calculated I-CVI greater than .78, which indicated that they achieved content validity for this construct of interest (pain). To review, these included: rocking unusually, lashing/striking out being less active, bangi ng his/her head, injuring oneself, crankiness (being more cranky than usual), lying ar ound/acting lethargic, increased heart rate, furrowing brow, s creaming/yelling/throwing tantrums, guarding (protecting) or favoring a part icular part of the body when moving, inconsolability (being unable to console), tensing face, and grimacing. When these items are compared to items in pain assessment tools currently available for use in related populations, there are similarities and differences The Primary and Secondary Pain Indicators derived from Study 2 are compared to three existing pain assessment tools in Table 5-1. The existing assessment tools chosen for comparison are the Non-Communicating Childrens Pain Checklist (NCCPC), the Pain Indicator for Communicativ ely Impaired Children (PICIC), and a Pain Evaluation Scale developed for children with CP. These three assessment tools were chosen for comparison because they have good psychometric properties and have demonstrated validity in the populations for which they were developed. When this Investigator

PAGE 102

102 generated the original item list, indicators from each of these existing tools were included so as to identify whether those indictor s were relevant, or not releva nt to children with ASD. Significant differences imply that using existing pain assessment tools with individuals having an ASD would not be valid, and might lend to inaccurate pain assessment. For example, pain indicators identified by careg ivers in Study 1 were added to the item list developed by this Investigator. Several of these items were subs equently validated by expe rts in Study 2, as being relevant to pain assessment in ASD (i.e., rocking unusually). These indicators however, are not seen in the existing pain assessment tools ava ilable for use in similar and related populations. Furthermore, several of the indicators that are utilized to assess pain in cognitively impaired, non-communicating children were not considered relevant to pain assessment in ASD. These included, for example: disinterest in surrounding s, less interaction w ith others, withdrawn, flinching or moving away, sensitive to touch, and jumping around, agitated, fidgety. Given the underlying nature of ASD, these behaviors are commonly exhibited due to their disorder (i.e., less interaction with others, withdrawn), and th us would not be useful in pain assessment. Other pain expressive indicator s included in existing assessment tools, but not determined to be relevant to pain assessment in ASD, involved behaviors more applicable to children with CPbecause of their associated motor impairment ssuch as stiff, spastic, tense and rigid, floppy, or searches for an unusual position that calms. Additionally, several physiological indicators and changes in daily activity that were included in other assessment scales were not considered relevant to pain assessment in ASD (shivering, sweating, perspiring, eating less, not interested in food, and increase in sleep). A number of pain indicators identified by careg ivers were subsequently determined to be relevant to pain assessment in ASD by pain and autism experts. These indicators included

PAGE 103

103 rocking unusually, lashing/st riking out, injuring oneself and banging his/her head. Other unique changes likely to indicate pain in this population, according to Study 2, include increased heart rate, and lying around/acting lethargic. One other finding that consistently arose throughout this res earch is that while ther e may be some unique pain indicators applicable to most children with ASD, there will also be those pain indicators identified by caregivers that are completely unique to the one child. Despite attempts to identify common pain indicators in children with ASD, pain assessment in this popul ation also seems to rely heavily on deviations from normal. Secondary Pain Indicators: Item Retention and Revision Several experts explained how they conceptualiz ed whether a n item was relevant to pain assessment in ASD. They indicated that they de termined an items relevance based on whether a particular indicator applied to all children with ASD (thus rating it as highly relevant), most children with ASD (quite relevant) some children with ASD (somewhat relevant) or not occurring at all in children with ASD (not relevant). As a result, a number of items (n = 19) were rated somewhat relevant by experts, but b ecause the I-CVI is calculated using only those ratings of quite and highly relevant, these items fell below the pre-established I-CVI cut-off of .78. Given that these items were close to the desired I-CVI of .78, and according to recommendations by Polit, Beck, and Owen (2007), it was determined that they should be closely examined before determining whether they should be discarded. Ta ble 5-2 lists the items with a calculated I-CVI = .67. Th is I-CVI (.67) was obtained when four of six experts rated the item as quite or highly relevant, and the other two rated the item as either not or somewhat relevant. When listing each item with an I-CVI of .67, as presented in Table 5-2, the differences in how experts rated each of these items can be more closely examined. Conceptually, there is a

PAGE 104

104 difference between the item where ALL experts believed it was somewhat relevant or higher, and the item where two experts believed it was not relevant at all, and the other four believed it was quite or highly relevant. These tw o items however, given the way the I-CVI is calculated, would have an identica l I-CVI. This is clearer when one looks at a calculated sum score for each item. If 1 = not relevant, 2 = somewhat relevant, 3 = quite relevant, and 4 = quite relevant, a summed score can be gene rated for each item, depending on how relevant each expert rated the item. The items can th en be rank-ordered and one can look at the relationships between them. Despite all items having and I-CVI of .67, the variability becomes evident when one looks at the range of sum scores (15 19) amongst all items with an I-CVI or .67. For example, experts rated sleeping less as not rele vant (n = 1), somewhat relevant (n = 1), and quite relevant (n = 4). The sum score for this item is 15 (1+2 +3+3+3+3 = 15). Stating/Repeating a specific pain word was rated somewhat relevant (n = 2), quite relevant (n = 1), and highly relevant (n = 3). The sum score for this item is 19 (2+2+3+4+4+4 = 19). There is a difference between the item that has one expert ra ting it not relevant and does not have any experts rating it as highly relevant, and the item that was never rated not relevant and has three experts rating it highly relevant. Th e methodology used to generate the I-CVI does not take this variability amongst the items with the same I-CVI into consider ation, and by dichotomizing the 4-point Likert scale, information about each item is lost, and might be to the detriment of the scales development. A number of items that might be relevant to pain assessment in ASD, which is a highly heterogeneous population, would be removed if the strict .78 cut-off is used, without examining those items just below the cut-off.

PAGE 105

105 Several of the Secondary Pain Indicators also need to be revised, as suggested by the expert panel. For example, crying should be combined with moaning, whining, whimpering, to generate one pain expressive behavior that captures what th e two separate indicators are reflecting: different degrees of vocalization. So the new item once the response format is determined, might be Vocalization. Caregivers would then rate thei r childrens vocalization on a Likert scale, choosing either: ( quiet ), 1 ( soft vocalization like moaning, whining, or groaning), 2 ( crying ), or ( screaming, yelling ). In doing this, the indicator screaming/yelling/throwing tantru ms would also be revised, and subsequently separated into screaming/yelling and throwing tantrums. Throwing ta ntrums would be taken out, resulting in a new items creationit was men tioned by one expert th at throwing a tantrum seems different than perhaps screaming or yelling in pain. Whenever items are revised, it is suggested th at they remain in the item list and undergo and second expert review to determ ine if revision made them more relevant to the instruments construct of interestin this case, assessing pain in children with ASD. All items that underwent some type of revision were retained in the item list for future examination of the items to further establish the content va lidity of a final set of items. The question arises in this research, what should be done with the Secondary Pain Indicators? Given a) the early stage of this instruments development, b) the methodological challenges associated with dichotomizing the I-CVI c) challenges associated with assessing pain in such a heterogeneous population, a nd d) the fact that this initial iteration revealed a need for several Secondary Item revisi ons, it was determined that th e Primary and Secondary Pain Indicators would both be utilized to generate the next it em list, and that an additional expert review is likely warranted. Item s subsequently not meeting Lynns (1986) criteria for adequate

PAGE 106

106 content validity will be removed after the next review by experts, and a final set of items will include only those indicators deemed most releva nt to pain assessment in ASD by experts. The findings from Study 1 highlight the variabil ity seen in children with ASD as reported by caregivers. Children with ASD present with va rious patterns of strengths and weakness, and thus it may be impractical to develop one assessment tool appropriate for all children with ASD. The Primary Pain Indicators highly endorsed by expe rts indicate that there may be several pain expressive behaviors unique to this population and somewhat common across all children with ASD. The Secondary Pain Indicators might be re levant to subpopulations of children with ASD, or simply not all children with ASD. Experts believed them to be somewhat relevant but simply not highly relevant. These items need to be further explored, systematically, in another round with expertsor perhaps in a subsequent study where the assessment tool is actually utilized by caregivers and providers of children with ASD. Items Removed from the Item List Following Expert Review. All item s with an I-CVI less than .67 (n = 44) were removed. Least relevant items included laughing, humming/si nging, becoming floppy, or limp, interacting more with others, eating more than usual, and ch ewing, moving tongue around and/or out, smacking lips. A number of items may be re levant to pain assessment in in dividual children with ASD, or perhaps in small subgroups of children with AS D. These items not commonly seen in ASD reflect a more individualized pain process. The next section discusses how to accommodate these individually significant (but less common) pain indicators, in light of several expert comments. Expert Comments and Suggestions The Investigator solicited experts who could address th e relevance of item s to pain assessment in ASD and offer insight regarding th e overall development of this pain assessment

PAGE 107

107 tool. Grant and Davis (1997) suggest using experts to help ensure items are clear, concise, and comprehensive. Expert suggestions regarding item revision were consid ered, and input on how to categorize the resulting pain indicators in an assessment tool was well received by this investigator. DeVellis (2003) points out however, th at the final decision to accept or reject the advice of your experts is your re sponsibility as the scale deve loper (p. 87). Given that suggestion, expert comments are presented here, but are considered in light of the overall goals and plans for this instruments development. A Need for Individualized Pain Assessmen t in this Population. Contrary to what experts believed to be relevant to pain assessment, several caregivers reported in Study 1 that laughing was sometimes an indication of pain in their children. This discord speaks to the fact that there will like ly continue to be unique and individual pain expressive indictors exhibited by children in this population. Expert suggestions that this instrument include a section focused on developmen t of an individual pa in profile for use in children with ASD were considered. This is similar to how Solodiuk and Curley (2003), as previously described, approach pain assessmen t in nonverbal children with severe cognitive impairment. Their instrument provides examples of pain expressive behaviors commonly seen in nonverbal children with cognitive impairment, and then asks caregivers to work from the suggested list to generate a pain expression profile unique to their child at various intensities of pain. Given the heterogeneity seen in children with ASD, it may be helpful to incorporate some of what Solodiuk and Curley (2003) have found us eful. Perhaps this assessment tool could be comprised of two parts. An initial part (Par t A) might recommend that caregivers watch for particular (those most common) pain expressive behaviors. This would be especially helpful for newly diagnosed children, or to caregivers who are watching for more t ypical pain expressive

PAGE 108

108 indicatorsand thus concluding th at their children do not feel pain. A second part (Part B) will allow caregivers to begin to determine their childs own pain profile. Once a comprehensive picture of how the child expresses physical pain is established, th is tool can be distributed to other individuals involved in his or her care. In this way, the tw o methods of pain assessment are merged. Suggestions of what to watch for are of fered, however it is also acknowledged that each child is different and unique in his or her pain expression. The Role of Direct Behavioral Obs ervation in Instrument Development The original item list generated for Study 2 ai med to include a wide variety of possible pain indicators in children with ASD. When the items were reviewed by experts, the role of direct observation in the instruments developm ent, and subsequent use with children was questioned and is therefore addressed here. It was acknowledged that several of the pain expressive indicators under review by experts are not directly obser vable, and require one to rely on caregiver reports of deviation from normal. These items include: unhappiness, acting off according to caregiver, and crankiness. Two were considered highly relevant to pain assessment in this population, and therefore clarification regardi ng the definition and operationalization of these items is necessary before re-evaluati ng the item list. This research illuminated the heavy emphasis on deviations from normal when assessing whether this population of children is in pain. While there we re several objective, observable, and measurable indicators presumed to be relevant to pain assessment in ASD (i.e., furrowed brow, banging his/her head, i njuring oneself, grimacing, guarding, and increased heart rate), many other identified indicators were subjective, and require a) knowledge of the childs baseline, and b) monitoring for changes from normal (i.e., crankiness, being less active, rocking unusually, acting off, irritability). Given this, there might need to be sections of the pain assessment tool that are objective a nd quantifiablethese coul d be used by someone

PAGE 109

109 unfamiliar with the childwhile ot her sections of the final assessment tool might be based on caregiver judgments regarding wh at is normal in their child. Caregiver information regarding their childs baseline, and thus deviations from normal will be critical to comprehensive pain assessment in this population. Future research in to whether caregivers subjective information correlates with objective, measurab le indicators is needed. In this way, direct observation of children would be extremely valuable. When beginning to explore pain assessment in children with ASD, this Investigator considered study designs that inco rporated direct observation of ch ildren presumed to be in pain, in order to inductively generate a list of observable beha viors potentially relevant to pain assessment in this population. The confusion that surrounded pain assessment in children with ASD however, made it difficult to theoretically determine what to watch for when observing this population. The reports that these children do not react to pain in the same manner as typically developing children hi ghlighted the need for initial pilot work aimed to simply characterize the issues en countered when assessing pain in this population. Thus the studies conducted in this research gathered descriptive information in order to deductively determine what types of pain expressive behaviors one would watch for when directly observing children. The next steps in this instruments development will certainly incorporate direct observation, and attempt to correlat e caregiver reports with certain pain expressive behaviors that are directly observable to someone unfamiliar wi th the child. Direct observation without any informed information regarding how children with ASD express pain would have been limited in its usefulness. Next Steps in this Instruments Development This instrument developm ent process began by a ttempting to articulate a) if children with ASD experience and express pain differently than typically developing child ren and b) whether it

PAGE 110

110 is possible to identify a set of pain expressi ve behaviors unique to this population. Study 1 findings indicate that children with ASD are capable of experiencing and expressing pain, however their pain expression is unique. Study 2 validates this uniqueness by identifying pain indicators specific to children with ASD, and by de monstrating that indicato rs relevant to other, similar, populations of children are not considered to be relevant to this population. Following Study 2, the resulting list of pain expressive behaviors deemed rele vant to children in ASD needs to be further examined. Therefore, the next step s in this instruments development involve a) the revision of particular items, b) re-evaluation of the new set of items (having been revised and recategorized), c) determination of how each item s hould be scaled, and d) additional testing of the final set of items to determine whether the resulting pain assessment tool is valid and reliable in children with ASD. In formalizing the final se t of items into a scale, each pain indicator will need to have its operational definition further articulated. Future item analysis involves examining th e final instruments applicability to the population of interest. It will need to be determ ined whether caregivers can utilize the tool to discern pain in their children with ASD. The pur pose of follow up research will be to a) examine how the items relate to one anothe r, and how each item influences the overall statistics of the tool (internal consistency), b) conduct correlation analyses to examin e whether total-item (summed) scores are different for children with various characteristics within the ASD population, c) examine the endorsement frequencythe propor tion of caregivers w ho give each response option to an itemof each item, and d) analyze th e caregivers mean usefulness ratings. It will be helpful to know which items caregivers endorse, and how useful the items are in determining whether their children are in pain.

PAGE 111

111 The next step following item analysis and adjust ment will be to further test the reliability and validity of the existing tool. Establishing construct validity will require a series of studies. Each additional study demonstrati ng that the instrument is useful further validates it as a pain assessment tool for the specified population. Th e purpose of a validation study is to determine whether the tool maintains adequate internal cons istency, to establish intrarater reliability, to examine concurrent and discriminant validity, and to determine whether caregivers can use it to discriminate between episodes of pain and nonpain. The most significant analysis for this particular study design will be to determine if the scores on the assessment tool differ between pain and nonpain episodes (discriminant validi ty). This repeated measures design requires Repeated Measures Analysis of Variance (RANOVA) The same caregivers will fill out the checklist during two separate pain events, and th erefore it will possible to examine the tools stability over time. It can be determined if the number of items observed is consistent, and whether the same items are endorsed for a child during two separate pain events. Mixed design RANOVA will allow one to examine whether there are differe nces between groups of subjects regarding a specific factor (i.e ., communication ability, age, etc) Finally, because the same caregivers will utilize the tool on two different oc casions, it will be possible to examine intrarater reliability in terms of caregiver use of the tool. Kappa coefficients analyzing the caregivers agreements when util izing the tool at each pain event will establish intrarater reliability. Streiner and Norman (1995) propos e that acceptable reliabi lities reported for instruments need to be greater than .75. Future studies will also incorporate video observation of children with ASD experiencing pain in perhaps a more clinical setting (post-operative pain fo r example) to establish other required forms of reliability (interrater) between different observers (observer, caregiver, staff

PAGE 112

112 nurse, researcher). Additionally, correlating instru ment scores with perhaps facial coding could help further establish concurrent validitygiven that facial codi ng is a well-established valid method for assessing for pain in children as so mewhat of a gold standard. There are no behavioral observation protocol s well validated for assessing pain in children with ASD, although there are specific behavior s that have been validated as observable pain indicators in other populations (elders with dementia, for exam ple). Capturing pain behavior on video would allow for additional exploration into how children with ASD exhibit pain from the perspective of pain experts, rather than caregiver report. This will be useful if the caregivers have difficulty discerning pain in their children with ASD, even after being given a re pertoire of behaviors thought to indicate pain in this population. Limitations Given the paucity of inform ation available to begin to investigat e the general question approached in this research, these studies were preliminary in nature, and aimed to explore and describe issues important to assessing pain in children with ASD. Several limitations were identified as each study was conducted, and thes e include the survey response rate, and the quasi-qualitative design u tilized in Study 1. Survey Response Rate A total of 400 surveys w ere mailed to caregiv ers of children with ASD in Study 1. Eightyeight surveys were completed and returned by mail, resulting in a 22% return rate. This lower response rate is problematic because it influen ces the validity of infe rring that the sample represents the population (H ulley, Newman, & Cummings, 2001, p. 31). However, a lower response rate might be expected in this par ticular population given th e tremendous challenges associated with caring for a child with this disorder. Many of these care givers are overwhelmed by the responsibilities required to ensure that th eir children receive the best intervention and care

PAGE 113

113 possible. A better response rate might have b een achieved if an incentive was included in the study design. Of those caregivers who did resp ond, almost all include d written descriptive responses, and 80% provided their name and numb er for a follow up call. This willingness to provide detailed information highlighted the strong desire to discuss and share concerns regarding pain assessment in their children with others. Quasi-Qualitative Design Study 1 afforded caregivers the opportunity to provide written desc riptions of their thoughts regarding the pain experi ence in their children. These wr itten responses were exam ined by the investigator and an autism expert and co mmonly reported issues were tallied. The most frequently reported issues were ut ilized to identify a few themes amongst this descriptive data. If the focus of this research was to specifically describe how caregivers perceived the pain experience in their children, a purely qualitative study would have been informing. However, the goal of Study 1 was to simply establish if pain assessment in children with ASD was a problem. Nothing in the literatur e to date addressed whether pa in assessment in ASD warrants an investigation. Study 1 was originally designed to obtain a snapshot of whether caregivers and healthcare providers would benefit from research focused on pain assessment in ASD. The sheer volume of written descriptive information provi ded by caregivers was surprising. Given this volume of descriptive data, more rigorous and formal qualitative inquiry might have been even more revealing. Other studies attempting to develop pain asse ssment tools for unique populations utilize caregivers to draft an in itial item list, as done for this rese arch. Some common methods used to solicit caregiver perspectives incl ude having them participate in focus groups, fill out checklists, and answer survey questions. This study was de signed in a similar fashion, foregoing the option

PAGE 114

114 to conduct an in-depth qualitative study, and c hoosing instead to complete two preliminary studies aimed at facilitating instrume nt development for this research. Nursing Implications and Clinical Significance As m embers of dynamic and inte rdisciplinary health care teams providing patient care, nurses are often directly responsible for assessi ng pain and initiating means to relieve patient suffering. In the absence of self-report, it is of ten the astute assessment of the subtleties in a patient that allow a good nurse to identify, interven e, and relieve pain. Th is awareness is even more critical when assessing and managing pain in several vulnerable populations of children. As the need for better pediatri c pain assessment emerged in the 90s, Ferrell, McCaffery, & Ropchan (1992) surveyed clinical nurses and identified barriers to adequate pain management. Top barriers included lack of knowledge on the part of the physicians, nurses, patient and family members, and system issues involving administration of pain medication. An effort has been made over the past several decades to increa se nursing knowledge of pain assessment and management in children, and to prioritize pain assessment and management in the clinical setting. This nursing research aimed to equip parent s and healthcare providers with the additional knowledge and understanding required to determine if and when a child with ASD might be experiencing pain. In pursuing the answers to the proposed research questions, it was the hope that many of the myths and controversial issu es surrounding the questi on of whether children with ASD are capable of feeling pain can be elim inated. Not only are nurs es directly involved in patient care management, but nur ses cross a myriad of settings and function at various practice levels. Dissemination of these research findings will equip nurses at the bedside, and nurses in the clinic setting, with the ability to better asse ss pain in children with ASD. Furthermore, the perceptions that children with ASD are incapabl e of feeling pain can be corrected. Nurses

PAGE 115

115 function as clinicians, advocates, and educator s. An accurate understanding of how children with ASD experience pain will ensure that pare nts of newly diagnosed children, or parents having a difficult time determining when their chil dren with ASD are in pain, are supported and taught about pain assessment and management in their children. Future Directions Instrum ent development requires diligence and dedication. A series of studies are required to ensure that a valid and reliable means of assess ing the construct of intere st results. The studies conducted in this research lay a foundation from which future instrument development can build. Future research aims to continue refining pain expressive indicators specific to children with ASD. As these indicators are further articulated, additional investigation into the variability in pain expression found along the spectrum is warrante d. It is likely that there are subgroups of children with ASD who have par ticular features infl uencing their specific pain expressive abilities (i.e., those with seve re abnormal sensory processing). The Communications Model of Pain (Had jistravopoulos & Crai g, 2002) highlights a variety of relationships that need to be explored. This resear ch demonstrated that caregiver perceptions, and existing myths or biases, likely influence ones abil ity to decode pain expressive behaviors in children with ASD. By focusing on the nonverbal and involuntary mechanisms of pain expression, it is possible to determine how children with ASD behaviorally exhibit their physical discomfort. Additional investigation in to how children with ASD respond to different types of pain is still neede d. It is possible that acute pain elicits a more reflexive, involuntary response, while everyday bumps and bruises (or mo re chronic types of pa in) require a greater understanding of the social c ontext surrounding the pain expe rience. This requirement (understanding the social context) would be impair ed in a population of children with social and communicative impairments (i.e., ASD).

PAGE 116

116 Additionally, future work will need to focus on caregivers abilities to accurately decode their childs pain expressive behavior, and examine whether their knowledge is appreciated and utilized by healthcare providers ac ross settings. Complaints that healthcare providers dismiss caregiver beliefs about their ch ildrens pain are alarming, and sp eak to a lack of partnership between some healthcare providers a nd caregivers in this population. Finally, work to disseminate findings follo wing the ultimate development of a pain assessment tool available for use in children wi th ASD will include examining the applicability of this tool to children in a va riety of settings. Hopefully, illumi nating the pain assessment issues specific to children with ASD will debunk circulating myths, and allow everyone involved in the care of a child with ASD to adequately assess, treat, and manage their pain.

PAGE 117

117Table 5-1. Comparison of expert-identified pa in indicators for use in ASD with pain indicators from three existing pain assessm ent tools Study 2: Items identified as relevant to pain assessment in ASD by experts Non-Communicating Childrens Pain Checklist (NCCPC); 30 Items Pain Indicator for Communicatively Impaired Children (PICIC); 6 Items Pain Evaluation Scale for CP; 10 Items Primary pain indicators (I-CVI > .78) Rocking unusually Lashing/striking out Guarding (protecting) or favoring a part of the body when moving Protecting, favoring, guarding part of body that hurts Coordinated defensive reaction of an area supposed painful protection of painful areas Increased heart rate Tensing face Screwed up or distressed looking face Painful expression Furrowing brow Furrowed brow Screwed up or distressed looking face Painful expression Grimacing Screwed up or distressed looking face Painful expression Screaming/yelling/throwing tantrums Screaming/yelling Screaming, yelling, groaning or moaning Injuring oneself Banging his/her head Disinterest in surroundings Lying around/acting lethargic Being less active Not moving, less active, Quiet Crankiness (being more cranky than usual) Not cooperating, cranky, irritable, unhappy

PAGE 118

118 Table 5-1. Continued Study 2: Items identified as relevant to pain assessment in ASD by experts Non-Communicating Childrens Pain Checklist (NCCPC) Pain Indicator for Communicatively Impaired Children (PICIC) Pain Evaluation Scale for CP Inconsolability (unable to c onsole) Difficult to distract, notable to satisfy or pacify Difficult to comfort or console Secondary pain indicators (I-CVI = .67) Acting off according to caregiver: not acting like him/her self Less interaction with others, withdrawn Flinching or moving body part away, sensitive to touch Flinches or moves away if touched Stiff, spastic, tense, rigid Body appears stiff or tense Tonic troubles: Stiffness Floppy Crying (with or without tears) Crying (moderately loud) Crying (with or without tears) Crying Moaning, whining, whimpering (softly) Moaning, whining Whimpering Moaning or inaudible cries Stating/repeating a specific pain-related word (i.e., hurt, ouch) Exhibits a specific word/sound for pain (or type of laugh) Does not communicate with others Moving body in a specific way to show pain Searches for an unusual position that calms Seeking comfort or physical touch Seeking comfort or physical closeness Touching, rubbing, picking, and/or tapping a specific part of the body Gesturing to or touching part of body that hurts Shivering

PAGE 119

119 Table 5-1. Continued Study 2: Items identified as relevant to pain assessment in ASD by experts Non-Communicating Childrens Pain Checklist (NCCPC) Pain Indicator for Communicatively Impaired Children (PICIC) Pain Evaluation Scale for CP Changing color, (flushing/redness) Change in color, (pallor) Sweating, perspiring Producing tears (without overt crying or vocalizations) Tears Increased rate of breathing Sharp intake of breath, Gasping Breath holding Eating less, not interested in food Increase in sleep Sleeping less Decrease in sleep Grinding teeth, clenching jaw down Clenching or grinding teeth, chewing or thrusting out tongue Frowning, turning down mouth Tu rning down of mouth Pouting, quivering, puckering lip s Lips puckering up, tight, pouting or quivering Widening eyes Change in eyes Becoming more aggressive (hitting, pinching, biting others) Acting angry Holding his/her head with both hands for prolonged periods of time Jumping around, agitated, Fidgety Increase in spontaneous movement (voluntary/not) Note: Primary and Secondary Pain Indicators are compared to item s included in existing pain assessment tools for use in related, but different, populations of child ren. Italicized items indicate that items are either unique to children with ASD or not relevant to children with ASD (because they were not validated in Study 2 by autism experts for use in this population).

PAGE 120

120Table 5-2. Study 2: Variability in expert-rated relevance amongs t all items with an I-CVI = .67 Pain behavior/indicator Not relevant Somewhat relevant Quite relevant Highly relevant Item CVISum Sleeping less 1 1 4 .67 15 Irritability (being more irritable than usual) 2 4 .67 16 Seeking comfort/physical touch 2 4 .67 16 Becoming more aggressive (hitting, pinching, biting others) 2 4 .67 16 Acting angry 2 4 .67 16 Widening eyes 1 1 3 1 .67 16 Frowning, turning down mouth 1 1 3 1 .67 16 Pouting, quivering, puckering lips 1 1 3 1 .67 16 Producing tears (without overt crying or vocalizations) 2 3 1 .67 17 Increased rate of breathing 2 3 1 .67 17 Acting off according to caregiver: not acting like him/herself 2 3 1 .67 17 Grinding teeth, clenching jaw down 2 3 1 .67 17 Squinching, squinting eyes 3 1 2 .67 17 Crying (with or without tears) 2 2 2 .67 18 Moaning, whining, whimpering (softly) 2 2 2 .67 18 Changing color (flushing, redness) 2 2 2 .67 18 Touching, rubbing, picking, and/or tapping a specific part of the body 2 2 2 .67 18 Holding his/her head with both hands for prolonged periods of time 2 2 2 .67 18 Stating/Repeating a specific pain-related word (i.e., hurt, ouch) 2 1 3 .67 19 Note: The numbers in each column indicate how many experts rated th e item as not, somewhat, quite, or highly relevant. The differences in sum score highlight the variability amongst a ll items with the same calculated I-CVI (.67).

PAGE 121

121 APPENDIX A STUDY 1: CAREGIVER SU RVEY COVER LETTER EXPL AINING PARTICIPATION Dear Paren t or Guardian, I am a nursing student at the University of Florida, and I am conducting a research study exploring how children with auti sm experience and express pain. The purpose of the study is to understand the thoughts parents have about whether their child feels, and can communicate when he or she is in pain. Participation in this study invol ves completing the attached brief survey. It should only take about 5-10 minutes to answer the three questions. Your responses will be kept completely anonymous. Please do not write your name on the survey. All responses will be grouped together, and there will be no way to link your responses to your identity. The completed surveys can be placed in the sealed envelope and either dropped in the box located by the exit, or may be returned to the staff member who gave it to you. Sealing your survey in the envelope ensures that your responses will not be opened by anyone other than myself. Participation in this study is completely voluntar y. You do not have to fill out the survey. You may withdraw from the study at any time. If you choose not to participate, this will have no effect on the care or treatment of your child or fa mily. Only the investigators involved in this study have the legal right to review your res ponses, and I assure you that we will protect the confidentiality of your information. If results from the study are published, anonymity will be maintained. If you have questions about your rights as a resear ch participant, you may call the Institutional Review Board at 352-846-1494. I will not be able to pay you for participating, but it will not cost you anything to participate. Thank you for you time in reading this letter and thinking about completing the survey. If you have any questions, please call Melissa Dodd (352-392-9409), or ask the staff presenting you with this survey. Sincerely, Melissa Dodd, MSN, ARNP Doctoral Student College of Nursing, University of Florida

PAGE 122

122 APPENDIX B STUDY 2: ITEM LIST FOR EXPERT REVIEW Instru ctions: Please review each item and determine whether it might be relevant for assessing pain in children with ASD (especial ly nonverbal children). Recall that these items will undergo further testing/validation, and do not reflect the final version of the pain assessment scale. You can simply place an x under the appropriate column below, re-save the co mpleted document with your name, and return to me via email. It is the goal of this process to obtain a number of items that might be re levant to this population by weeding out irrelevant indicators. If there are behaviors that need to be considered but are not on this list, feel free to suggest that they be added. Those items rated as relevant by the majority of expert reviewers will remain in the item pool for the next step in the development of this tool. The final list of items will be utilized to construct a more formal pain assessment tool which will undergo additional expert review fo r item style (wording, clarity), and then be distributed to a test sample to evaluate overall tool comprehens iveness (understanding instructions, response format, length, etc). Pain Behavior /Indicator NOT Relevant SOMEWHAT Relevant QUITE Relevant HIGHLY Relevant Vocal/Verbal Indicators Crying (with or without tears) Screaming/Yelling/Throwing Tantrums Stating/Repeating a specific painrelated word (i.e. hurt, ouch) Stating/Repeating a specific non-pain word or phrase (i.e. bat, toe) Babbling (Saying something incomprehensible) Moaning, whining, whimpering (softly) Humming/Singing Laughing Vocalizing less than normal, getting quiet Physiological Sweating, perspiring Producing tears (without overt crying or vocalizations) Shivering, shaking Increased rate of breathing Decreased rate of breathing Changing color (paleness)

PAGE 123

123 Changing color (flushing, redness) Increased heart rate Fever Feeling cool or cold to touch Activity/Movement Sitting still Fidgeting, becoming more active, jumping around (motor restlessness) Muscle tensing, rigidity Guarding (protecting) or favoring a particular part of the body when moving Touching, rubbing, picking, and/or tapping a specific part of the body Seeming hypersensitive (overly sensitive) to touch Seeming less sensitive to touch Becoming floppy, or goes limp Being less active Lashing/Striking out Changing his/her usual body language Holding his/her head with both hands for prolonged periods of time Stomping foot Clapping hands loudly Rocking unusually Scratching a specific part of the body Banging his/her head Clapping hands loudly Behavioral Holding breath Injuring oneself Crankiness (being more cranky than usual) Cooperating less than normal Irritability (being more irritable than usual) Unhappiness Interacting less than normal with others Interacting more than normal with others Seeking comfort/physical touch Isolating oneself more, hiding Moving to, or staying in, a specific location or safe space

PAGE 124

124 Perseverating more on a particular item Making up stories or reenacting a painful circumstance Acting off according to caregiver: not acting like him/herself Becoming more aggressive (hitting, pinching, biting others) Inconsolability (being unable to console) Loosing interest in things that are usually extremely important or interesting to child Increasing number and/or frequency of repetitive behaviors Acting angry Decreasing number and/or frequency of repetitive behaviors Daily Activities Sleeping less Sleeping more Eating less, not interested in food Eating more than usual Laying around, acting lethargic Facial Grinding teeth, clenching jaw down Chewing, moving tongue around and/or out, smacking lips Furrowing brow Squinching, squinting eyes Widening eyes Frowning, turning down mouth Pouting, quivering, puckering lips Tensing face Facial restlessness, tics Grimacing Lip biting Continuous eye blinking Rolling eyes Flaring nostrils Raising eyebrows Lip curling

PAGE 125

125 Please feel free to offer comments, or recommend additional behavioral i ndictors that might not have been listed above. Again, thank you.

PAGE 126

126 APPENDIX C STUDY 2: ITEM LIST COVER LETTER EXP LAINING STUDY AND PARTICIPATION Dear Participant, I am a doctoral candidate in Nursing, at the Univer sity of Florida, and am inviting you to participate because of your experience in caring for children w ith autism spectrum disorders. Thank you for taking the time to provide your expert insight regarding how children with autism spectrum disorder (ASD) behaviorally express physical pain. My research seeks to better understand how children with ASD express their physical pain, and aims to ultimately equip providers and caregivers with a tool that can be used to assess pain in this population, specifically in those children unable to ve rbally communicate their discomfort. Because of the lack of information regarding how children with ASD express pain, and because of the confusion that surrounds this issue (given various re ports of these children having a high tolerance for pain), it was determined that the development of a new pain assessment tool for this population is warranted; specifically, for those children with ASD who have severe communication and language impairments. Existing pain assessment tools have not been utilized and/or validated in this population, and there are limitations to using traditional pain assessment methods in children with ASD. Given the unique nature of this disorder, and the heterogeneity found in children on the spectrum, this population requires a novel approach to pain assessment. The development of this tool is in the early stages. Recent work aimed to generate a long list of items that might indicate pain in children with ASD who cannot verbally communicate well. The current item pool you will review presents this list of behaviors. Th is list has been thoughtfully derived from several sources: the pain and autism literature, one-to-one di scussion with several autism experts, semi-structured caregiver interviews, and caregiver surveys that asked about the pain experience in their children with autism. The next step in examining these theoretical items is to have a panel of experts review the potential indicators, and rate whether each one is releva nt to this population. This will ensure that the revised set of items (which will undergo further review via a large test sample in the next step of instrument development) achieves adequate content validity Your thought regarding whether each item should remain in the item pool at this stage in instru ment development is crucial to ensuring that all potential indicators have been considered, and included. Given the heterogeneous nature of this disorder, it is acknowledged that this (creating a universal pain assessment tool for this population) might not be pos sible, however it is believed that in attempting to gather information regarding how ch ildren with autism express pain, we can illuminate the fact that while some children might seemingly show an insensitivity to pain, many children on the spectrum do in fact feel and process pain, and therefore cannot be ig nored or dismissed regarding appropriate pain management. I sincerely appreciate your time, and am availabl e should you have additional comments, insights, or questions. Kindest Regards, Melissa Dodd Inglese, Do ctoral Candidate, ARNP University of Florida College of Nursing

PAGE 127

127 LIST OF REFERENCES Akhtar, N. (1999). Acquiring basic word order: Evidence for data -driven learning of syntactic structure. Journal of Child Language, 26, 339. Allen, M. J., & Yen, W M. (1979). Introduction to measurement theory. Long Grove, IL: Waveland Press, Inc. Alligood, M. R., & Tomey, A. M. (2002). Introd uction to nursing theory : History, terminology, and analysis. In A. M. Tomey & M. R. Alligood (Eds.), Nursing theorists and their work (5th ed., pp. 3). St. Louis, MO: Mosby, Inc. American Academy of Pediatrics Committee on Bi oethics (1995). Informed consent, parental permission, and assent in pediatric practice. Pediatrics, 95 (2), 314. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (Revised 4th ed.). Washington, DC: Author. Anand, K. J. S. (1989). The neuroanatomy, neur ophysiology, and neurochemistry of pain, stress, and analgesia in newborns and children. Pediatric Clinics of North America, 36(4), 795 817. Anand, K. J. S., & Craig, K. D. (1996). New perspectives on the definition of pain. Pain, 67, 3 6. Ascension Health (2007). Healthca re ethics: Principle of informed consent. Retrieved July 14, 2007 from http://www.ascensionhealth.or g/ethics/public/key_principles/ informed_consent.asp Autism Society of America. (2006). Next steps: A guide for families new to autism. Retrieved June 13, 2007 from https://secure2.convio.net/asa/site/ Ecommerce?store_id=2221&JServS essionIdr011=km0qfshmu2.app26a Barbaresi, W. J., Katusic, S. K., Colligan, R. C., Weaver, A. L., & Jacobsen, S. J. (2005). The incidence of autism in Olmsted County, Minnesota, 1976: Results from a population-based study. Archives of Pediatric an d Adolescent Medicine, 159, 37. Barclay, L. (2005). Autism epidemic? A newsmaker interview with Morton Ann Gernsbacher, PhD, and Craig J. Newschaffer, PhD Retrieved June 12, 2007 from http://www.medscape.com/viewarticle/508429_print Baron-Cohen, S. (1995). Mindblindedness: An essay on autism and theory of mind. Boston: MIT Press/Bradforn Books.

PAGE 128

128 Baron-Cohen, S., & Swettenham, J. (1997). Theo ry of mind in autism: Its relationship to executive function and central coherence. In D. J. Cohen & F. R. Volkmar (Eds.), Handbook of autism and pervasive developmental disorders (2nd ed., pp. 880). New York: John Wiley & Sons, INC. Baron-Cohen, S., Tager-Flusberg, H. & Cohen, D. J. (Eds.). (1993). Understanding other minds: Perspectives from autism. Oxford: Oxford University Press. Bassett, J. (2005). Young suffering. Advance for Directors in Rehabilitation, 14 (10), 40. Beauchamp, T. L., & Walters, L. (1999). Contemporary issues in bioethics (5th ed.). Belmont, CA: Wadsworth Publishing Company. Beauchamp, T. L., & Walters, L. (2003). Contemporary issues in bioethics (6th ed.). Belmont, CA: Wadsworth Publishing Company. Belschner, R. A. (2007). Stop, assess and motiv ate: The SAM approach to autism spectrum disorder. The American Journal for Nurse Practitioners, 11 (4), 43. Bowers, J. W., & Bradac, J. J. (1982). Issues in communication theory: A metatheoretical analysis. In M. Burgoon (Ed.), Communication yearbook 5 (pp. 1). New Brunswick, NJ: Transaction Books. Breau, L. M., Camfield, C., McGrath, P. J., Rosm us, C., & Finley, G. A. (2001). Measuring pain accurately in children with cognitive impairments: Refinement of a caregiver scale. The Journal of Pediatrics, 138, 721. Breau, L. M., Finley, G. A., McGrath, P. J., & Camfield, C. S. (2002). Validation of the noncommunicating childrens pain ch ecklist postoperative version. Anesthesiology, 96 528. Breau, L. M., McGrath, P. J., Camfield, C. S., & Finley, G. A. (2002). Psychometric properties of the non-communicating childrens pain checklist-revised. Pain, 99, 349. Breau, L. M., McGrath, P. J., Camfield, C. S., Rosmus, C., & Finley, G. A. (2000). Preliminary validation of an observational pain checklist for persons w ith cognitive impairments and inability to communicate verbally. Developmental Medicine & Child Neurology, 42, 609. Brown, N. J., Berkovic, S. F., & Scheffer, I. E. (2007). Vaccination seizures and vaccine damage. Current Opinion in Neurology, 20 181. Bruner, J. S. (1983). Childs talk: Learning to use language. NY: W. W. Norton.

PAGE 129

129 Budwig, N., Wertsch, J. V., & Uzgiris, I. C. (2000). Introduction: Communication, meaning, and development: Interdisciplinary perspectives. In I. E. Sigel (Series Ed.) & N. Budwig, I. C. Uzgiris, & J. V. Wertsch (Vol. Eds.), Communication: An arena of development: Vol. 19. Advances in applied developmental psychology (pp. 1). Stamford, CT: Ablex Publishing Company. Bursch, B., Ingman, K., Vitti, L., Hyman, P., & Zeltz er, L. K. (2004). Chroni c pain in individuals with previously undiagnosed autistic spectrum disorders. The Journal of Pain, 5 (5), 290 295. Carpenter, M., & Tomasello, M. (2000). Jo int attention, cultural learning, and language acquisition: Implications for children with au tism. In S. F. Warren & J. Reichle (Series Eds.) & A. M. Wetherby & B. M. Prizant (Vol. Eds.), Communication and language intervention series: Vol. 9: Autism spectru m disorders: A transactional developmental perspective. (pp. 31). Carter, B., McArthur, E., & Cunliffe, M. (2002). Dealing with uncertainty: Parental assessment of pain in their children with profound special needs. Journal of Advanced Nursing, 38(5): 449 Centers for Disease Control and Prevention. (1999). Thimerosal in vaccines: A joint statement of the American Academy of Pediatrics and the Public Health Service. MMWR, 48, 563 565. Centers for Disease Control and Prevention. (2000). Notice to r eaders: Summary of the Joint Statement on Thimerosal in Vaccines. MMWR, 49, 622. Centers for Disease Contro l and Prevention. (2007). How common are autism spectrum disorders (ASD)? Retrieved March 3, 2007, from http://www.enotalone.com/article/6965.html Champion, G. D., Goodenough, B., von Baeyer, C. L., & Thomas, W. (1998). Measurement of pain by self-report. In Internat ional Association for the Study of Pain (Series Ed.) & G. A. Finley & P. J. McGrath (Vol. Eds.), Progress in pain research and management: Vol. 10. Measurement of pain in infants and children (pp. 123) Seattle, WA: International Association for the Study of Pain Press. Charman, T. (2003). Why is joint attention a pivotal skill in autism? Philosophical Transactions of the Royal Society of London. Se ries B, Biological Sciences, 358, 315. Charman, T., & Baird, G. (2002). Practitioner review : Diagnosis of autism spectrum disorder in 2and 3-year-old children. Journal of Child Psychology and Psychiatry, 43 (3), 289. Cicchetti, D. V., & Sparrow, S. (1981). Developing criteria for establishing interrater reliability of specific items: Application to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127.

PAGE 130

130 Collignon, P., & Giusiano, B. (2001). Validation of a pain evaluation scale for patients with severe cerebral palsy. European Journal of Pain, 5, 433. Craig, K. D. (1998). The facial display of pain. In International A ssociation for the Study of Pain (Series Ed.) & G. A. Finley & P. J. McGrath (Vol. Eds.), Progress in pain research and management: Vol. 10. Measurement of pain in infants and children (pp. 103) Seattle, WA: International Association for the Study of Pain Press. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory Australia: Wadsworth Group. Dance, F. E. X. (1970). The concept of communication. Journal of Communication, 20, 201 210. Dawson, G., Toth, K., Abbott, R., Osterling, J., M unson, J., Estes, A. et al. (2004). Early social attention impairments in autism: Social orienting, joint atten tion, and attention to distress. Developmental Psychology, 40 (2), 271. Dawson, G., Webb, S., Schellenberg, G. D., Dager, S., Friedman, S., Aylward, E., et al. (2002). Defining the broader phenotype of autism: Ge netic, brain, and beha vioral perspectives. Development and Psychopathology, 14, 581. Decker, S. A., & Perry, A. G. (2003). The develo pment and testing of th e PATCOA to assess pain in confused older adults. Pain Management Nursing, 4 (2), 77. DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Thousand Oaks, CA: Sage Publications. Deyo, K. S., Prkachin, K. M., & Mercer, S. R. (2004). Development of se nsitivity to facial expression of pain. Pain, 107, 16. Dover, C. J., & Le Couteur, A. (2007). How to diagnose autism. Archives of Disease in Childhood, 92, 540. Fawcett, J. (2005). Criteria for evaluation of theory. Nursing Science Quarterly, 18 (2), 131. Ferrell, B. R., McCaffery, M., & Ropchan, R. (1992) Pain management as a clinical challenge for nursing administration. Nursing Outlook, 40 (60), 263. Ferrel, B. R., Novy, D., Sullivan, M. D., Banja, J., Dubois, M. Y., Gitlin, M. C., et al. (2001). Ethical dilemmas in pain management. The Journal of Pain, 2 (3), 171. Filipek, P.A., Accardo, P. J., Baranek, G. T., Cook, E. H., Jr., Dawson, G., Gordon, B., et al. (1999). The screening and diagnosis of autistic spectrum disorders. Journal of Autism and Developmental Disorders, 29 (6), 439.

PAGE 131

131 Finley, G. A., & McGrath, P. J. (1998). Intr oduction: The roles of measurement in pain management and research. In International A ssociation for the Study of Pain (Series Ed.) & G. A. Finley & P. J. McGrath (Vol. Eds.), Progress in pain research and management: Vol. 10. Measurement of pain in infants and children (pp. 1) Seattle, WA: International Association for the Study of Pain Press. Fodor, J. A. (1983). The modularity of mind. Cambridge, MA: MIT Press. Fombonne, E. (2001). Is there an epidemic of autism? Pediatrics, 107 411. Fombonne, E. (2003). Epidemiological surveys of autism and other pervasive developmental disorders: An update. Journal of autism and Developmental Disorders, 33, 365. Fombonne, E. (2005). Epidemiological studies of pervasive developmental disorders. In F. R. Volkmar, R. Paul, A. Klin, & D. Cohen (Eds.), Handbook of autism and pervasive developmental disorders: Vol. 1. Diagnosis development, neurobiology, and behavior (3rd ed., pp. 42). Hoboken, NJ: John Wiley & sons, Inc. Francois, G., Duclos, P., Margolis, H., Lavanchy, D., Siegrist, C., Meheus, A., et al. (2005). Vaccine safety controversies and th e future of vaccination programs. The Pediatric Infectious Disease Journal, 24 (11), 953. Freitag, C. M. (2007). The genetics of autistic diso rders and its clinical re levance: A review of the literature. Molecular Psychiatry, 12 2. Frith, U. (1989). Autism: Explaining the enigma. Oxford: Blackwell. Frith, U. (2003). Autism: Explaining the enigma (2nd ed.). United Kingdom: Blackwell Publishing. Gaffney, A., McGrath, P., & Dick, B. (2003). Meas uring pain in childr en: Developmental and instrument issues. In N. L. Schechte r, C. B. Berde & M. Yaster (Eds.), Pain in infants, children, and adolescents (2nd ed., pp. 128). Philadelphia, PA: Lippincott Williams & Wilkins. Gilbert-MacLeod, C. A., Craig, K. D., Rocha, E. M., & Mathias, M. D. (2000). Everyday pain responses in children with and without developmental delays. Journal of Pediatric Psychology, 25 (5), 301. Gernsbacher, M. A., Dawson, M., & Goldsmith, H. H. (2005). Three reasons not to believe in an autism epidemic. Current Directions in Ps ychological Science, 14 (2), 55. Giusiano, B., Jimeno, M. T., Collignon, P., & Chan, Y. (1995). Utilization of a neural network in the elaboration of an evaluation sc ale for pain in cerebral palsy. Methods of Information in Medicine, 34, 498. Grant, J. S., & Davis, L. L. (1997). Selecti on and use of content experts for instrument development. Research in Nursing & Health, 20, 269.

PAGE 132

132 Hadden, K. L., & von Baeyer, C. L. (2002). Pain in children with cerebral palsy: Common triggers and expressive behaviors. Pain 99 (1), 281. Hadjistavropoulos, T. (2004). Ethics for psychologists who treat, a ssess, and/or study pain. In T. Hadjistavropoulos & K. D. Craig (Eds.), Pain: Psychological perspectives (pp. 327 344).Mahwah, NJ: Lawrence Erlbau m Associates, Publishers. Hadjistavropoulos, T., & Craig, K. D. (2002). A theoretical fr amework for understanding selfreport and observational measures of pain: A communications model. Behavior Research and Therapy, 40 551. Hadjistavropoulos, T., Craig, K. D., & Fuchs-L acelle, S. (2004). Social influences and the communication of pain. In T. Had jistavropoulos & K. D. Craig (Eds.), Pain: Psychological perspectives (pp. 87) Mahwah, NJ: Lawrence Erlbaum Associaties, Publishers. Happe, F. (1996). Studying weak central coherence at low levels: Children with autism do not succumb to visual illusions. Journal of Child Psychology and Psychiatry, 37 873. Happe, F., Ronald, A., & Plomin, R. (2006). Time to give up on a single explanation for autism. Nature Neuroscience, 9(10), 1218. Harrington, J. W., Patrick, P. A., Edwards, K. S ., & Brand, D. A. (2006). Parental beliefs about autism: Implications for the treating physician. Autism, 10(5), 452. Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content valid ity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment 7(3), 238. Helseth, S., & Slettebo, A. (2004). Research involving children: Some ethical issues. Nursing Ethics, 11 (3), 298. Hennequin, M., Morin, C., & Feine, J. S. (2000). Pain expression and stimulus localization in individuals with Downs syndrome. Lancet, 356(9245), 1882. Herbert, M. R. (2005). Autism: A brain disorder, or a disorder that affects the brain? Clinical Neuropsychiatry, 2 (6), 354. Hill, E. L., & Frith, U. (2003). Understand ing autism: Insights from mind and brain. Philosophical Transactions of the Royal Society of London, 358, 281. Hoff, E. (2005). Language development (3rd ed.). Belmont, CA: Wadsworth Thomson Learning. Howlin, P. (1998). Practitioner review: Psychologi cal and educational treatments for autism. Journal of Child Psychology and Psychiatry, 39(3), 307. Hughes, C. (1998). Finding your marbles: Does preschoolers strategic be havior predict later understanding of mind? Developmental Psychology, 34 (6), 1326.

PAGE 133

133 Hulley, S. B., Cummings, S. R., Browner, W. S., Grady, D., Hearst, N., & Newman, T. B. (2001). Designing clinical research (2nd ed.). Philadelphia, PAL Lippincott Williams & Wilkins. Hunt, A., Mastroyannopoulou, K., Goldman, A., & Seers, K. (2003). Not knowing: The problem of pain in children with severe neurological impairment. International Journal of Nursing Studies, 40 (2), 171. Institute of Medicine. (2001). Immunization safety review: me asles-mumps-rubella vaccine and autism Retrieved July 2, 2007 from http: //books.nap.edu/catalog.php?record_id=10101 Institue of Medicine. (2004). Immunization safety revi ew: vaccines and autism Retrieved July 2, 2007 from http://books.nap.edu/catalog/10997.html International Association for the Study of Pa in (2007). IASP pain terminology. Retrieved April 25, 2007 from http://www.iasp-pain.org/AM/T emplate.cfm?Section=Home&template=/ CM/HTMLDisplay.cfm&ContentID=3088#Pain Jarrold, C., Butler, D. W., Cottington, E. M., & Ji menez, F. (2000). Linking theory of mind and central coherence bias in autis m and in the general population. Developmental Psychology, 36(1), 126. Johnston, C. C., Stevens, B. J., Boyer, K., & Porter, F. L. (2003). Development of psychologic responses to pain and assessment of pain infant s and toddlers. In N. L. Schechter, C. B. Berde & M. Yaster (Eds.), Pain in infants, children, and adolescents (2nd ed., pp. 105 127). Philadelphia, PA: Lippincott Williams & Wilkins. Kanner, L. (1943). Autistic distur bances of affective contact. Nervous Child, 2, 217. King, I. M. (1981). A theory for nursing: Systems, concepts, process. Albany, NY: Delmar Publishers Inc. Klin, A., McPartland, J., & Volkmar, F. R. (2005). Asperger syndrome. In F. R. Volkmar, R. Paul, A. Klin, & D. Cohen (Eds.), Handbook of autism and perv asive developmental disorders: Vol. 1. Diagnosis, development neurobiology, and behavior ( 3rd ed., pp. 88 125). Hoboken, NJ: John Wiley & Sons, Inc. Kolevzon, A., Gross, R., & Reichenberg, A. (200 7). Prenatal and perina tal risk factors for autism: A review and integration of findings. Archives of Pediatric and Adolescent Medicine, 161 326. Kuhl, P. K. (2000). A new view of language acquisition. Proceedings of the National Academy of Sciences, 97(22), 11850. Kuhl, P. K. (2005). Links between social and linguistic processing of speech in preschool children with autism: Behavioral and electrophysiological measures. Developmental Sciences, 8 (1), F1F12.

PAGE 134

134 Kutscher, M. L. (2006). Autistic spectrum disorders: Sorting it out. Retrieved June 28, 2007 from http://pediatricneurology.com/autism.htm#Asperger%E2%80%99s%20Syndrome Leeds-Hurwitz, W. (1989). Communicat ion as multichannel behavior. In Communication in everyday life (pp. 101). Norwood, NJ: Ablex Publishing Company. Lord, C., & Paul, R. (1997). Language and communica tion in autism. In D. J. Cohen & F. R. Volkmar (Eds.), Handbook of autism and pervasive developmental disorders (2nd ed., pp. 195). New York: John Wiley & Sons, INC. Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382. Marcus, G., & Rabagliati, H (2006) What developmental disorders can tell us about the nature and origins of language. Nature neuroscience, 9 (10), 1226. Martin, I., & McDonald, S. (2003). Weak coherence, no th eory of mind, or executive dysfunction? Solving the puzzle of pragmatic language disorders. Brain and Language, 85, 451. McCaffery, M., & Beebe, A. (1989). Pain: Clinical manual for nursing practice. Philadelphia, PA: Mosby. McGrath, P. J. (1998). Behavioral measures of pa in. In International Asso ciation for the Study of Pain (Series Ed.) & G. A. Finley & P. J. McGrath (Vol. Eds.), Progress in pain research and management: Vol. 10. Measurement of pain in infants and children (pp. 83) Seattle, WA: International Association for the Study of Pain Press. McGrath, P. J., Rosmus, C., Canfield, C., Cam pbell, M. A., & Hennigar, A. (1998). Behaviors caregivers use to determine pain in non-verbal, cognitively impaired individuals. Developmental Medicine & Child Neurology, 40 340. Meltzoff, A. N. (1999). Origins of theo ry of mind, cognition, and communication. Journal of Communication Disorders, 32 251. Melzack, R., & Wall, P. D. (1965). Pain mechanisms: A new theory. Science, 150, 971. Mercer, L., Creighton, S., Holden, J. J. A., & Lewi s, M. E. S. (2006). Parental perspectives on the causes of an autism spectrum disorder in their children. Journal of Genetic Counseling, 15(1), 41. Merskey, H. (1991). The definition of pain. European Journal of Psychiatry, 6, 153. Mitchell, S., Brian, J., Zwaigenbaum, L, Roberts, W., Szatmari, P., Smith, I., et al. (2005). Early language and communication development of infants later diagnosed with autism spectrum disorder. Developmental and Behav ioral Pediatrics, 27 (2), S69S78.

PAGE 135

135 Morgan, B., Maybery, M., & Durkin, K. (2003). W eak central coherence, poor joint attention, and low verbal ability: Indepe ndent deficits in early autism Developmental Psychology, 39(4), 646. Muhle, R., Trentacoste, S. V., & Rapi n, I. (2004). The genetics of autism. Pediatrics, 113(5), e472e486. Retrieved June 30, 2007 from http://www.pediatrics.org/cgi/content/full/113/5/e472 Murch, S., Anthony, A., Casson., D., Malik, M., Be rlowitz, M., Dhillon, A. et al. (2004). Retraction of an interpretation. Lancet, 363 750. National Institute of Mental Health (2007). Autism spectrum disorders (pervasive developmental disorders). Retrieved June 11, 2007, from http://www.nimh.nih.gov/publicat/autism.cfm Nader, R., Oberlander, T. F., Chambers, C. T ., & Craig, K. D. (2004). Expression of pain in children with autism. Clinical Journal of Pain, 20 (2), 88. Neimark, J. (2007). Autism: Its not just in the head Retrieved June 30, 2007 from http://discovermagazine.com/2007/apr/autismit2019s-not-just-in-the -head/article_print Newschaffer, C. J., Falb, M. D., & Gurney, J. G. (2005). National autism prevalence trends from United States special education data. Pediatrics, 115 (3), e277e282. Retrieved June 12, 2007 from www.pediatrics.org /cgi/doi/10.1542/peds.2004-1958 Oberlander, T. F., & Craig, K. D. (2003). Pain an d children with developm ental disabilities. In N. L. Schechter, C. B. Berde, & M. Yaster (Eds.), Pain in infants, children, and adolescents ( 2nd ed., pp. 599). Philadelphia: Li ppincott Williams & Wilkins. ONeill, M., & Jones, R. S. P. (1997). Sensory-perceptual abnormalities in autism: A case for more research. Journal of Autism and Developmental Disorders, 27 (3), 283. Ozonoff, S. (1995). Executive functions in auti sm. In E. Schopler & G. B Mesibov (Eds.), Learning and cognition in autism (pp. 199). New York: Plenum Press. Ozonoff, S., & Jensen, J. (1999). Brief report: Specific executive func tion profiles in three neurodevelopmental disorders. Journal of Autism and Developmental Disorders, 29 (2), 171. Parse, R. R. (2000). Obfuscating: Th e persistent practice of misnaming. Nursing Science Quarterly, 13 (2), 91. Peterson, S. J. (2004). Introduction to the nature of nursing knowledge. In S. J. Peterson & T. S. Bredow (Eds.), Middle range theories: Application to nursing research (pp. 3). Philadelphia: Lippincott Williams & Wilkins. Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know whats being reported? Critique and recommendations. Research in Nursing & Health, 29, 489 497.

PAGE 136

136 Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30, 459. Portney, L. G., & Watkins, M. P. (2000). Foundations of clinical re search: Applications to practice (2nd ed.). Upper Saddle River, NJ: Prentice Hall Health. Pratt, C., & Buckman, S. (2007). Supporting appropriate behavior in students with aspergers. Retrieved June 13, 2007 from https://secure2.convio.net/asa/site/ Ecommerce?store_id=2221&JServS essionIdr011=km0qfshmu2.app26a Rimland, B. (1964). Infantile autism: The syndrome and its im plications for a neural theory of behavior. Englewood Cliffs, NJ: Prentice-Hall Inc. Roth-Isigkeit, A., Thyen, U., Stoven, H., Schwar zenberger, J., & Schmucker, P. (2005). Pain among children and adolescents: Restrictions in daily living and triggering factors. Pediatrics 115 (2), e152e162. Retrieved March 19, 2007 from http://www.pediatrics.org/cgi/content/full/115/2/e152 Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by 8-month-old infants. Science, 274, 1926. Silverman, C., & Brosco, J. P. (2007). Unders tanding autism: Parents and pediatricians in historical perspective. Archives of Pediatric and Adolescent Medicine, 161 392. Smith, D. R., & Williamson, L. K. (1977). Traditions. In Interpersonal communication (pp. 27 32). Dubuque, IA: William. C. Brown. Snow, C. E. (1999). Social pers pectives on the emergence of la nguage. In B. MacWhinney (Ed.), The emergence of language (pp. 257). Mahwah, NJ: Erlbaum. Solodiuk, J., & Curley, M. A. Q. (2003). Pain assessment in nonverbal children with severe cognitive impairments: Individualiz ed numeric rating scale (INRS). Journal of Pediatric Nursing, 18(4), 295. Stallard, P., Williams, L., Lenton, S., & Velleman, R. (2001). Pain in cognitively impaired, noncommunicating children. Archives of Disease in Childhood 85 460. Retrieved March 19, 2007 from http://adc.bmj.com/cgi/content/full/85/6/460 Stallard, P., Williams, L., Velleman, R., Lenton, S., & McGrath, P. J. (2002). Brief report: Behaviors identified by caregivers to de tect pain in noncommunicating children. Journal of Pediatric Psychology, 27 (2), 209. Stevens, B. (1998). Composite measures of pain In International Association for the Study of Pain (Series Ed.) & G. A. Finley & P. J. McGrath (Vol. Eds.), Progress in pain research and management: Vol. 10. Measurement of pain in infants and children (pp. 161) Seattle, WA: International Association for the Study of Pain Press.

PAGE 137

137 Stevens, B. J., McGrath, P., Yamada, J., Gi bbins, S., Beyene, J., Br eau, L. et al. (2006). Identification of pain indicators for infants at risk for neurological impairment: A Delphi consensus study. BMC Pediatrics, 6 (1). Retrieved March 28, 2008, from http://www.biomedcentral.com/1471-2431/6/1 Streiner, D. L., & Norman, G. R. (1995). Health measurement scales: A practical guide to their development and use (2nd ed.). New York: Oxford University Press. Sunil, K. (2006). Autism: A review for family physicians. Indian Journal of Medical Sciences, 60(5), 205. Szpir, M. (2006). Tracing the origins of autism: A spectrum of new studies [Electronic version]. Environmental Health Perspectives, 114 (7), A412A418. Taylor, B. (2006). Vaccines and th e changing epidemiology of autism. Child: Care, health, and development, 32 (5), 511. Terstegen, C., Koot, H. M., de Boer, J. B., Tibboe l, D. (2003). Measuring pain in children with cognitive impairment: Pain response to surgical procedures. Pain, 103(1), 187. Tomasello, M. (1992). The social bases of language acquisition. Social Development, 1, 67. Tomasello, M. (2003). Constructi ng a language: A usage-based theory of language acquisition. Cambridge, MA: Harvard University Press. University of Florida Institutional Review Board (2003/2004, December/January) Waiver of informed consent. Health Center IRB InvestiGATOR 6(12), 1. Retrieved July 15, 2007 from http://irb.ufl.edu/edu cation/InvestiGATORS.htm Villarruel, A. M., Bishop, T. L., Simpson, E. M., Jemmott, L. S., & Fawcett, J. (2001). Borrowed theories, shared theories, and the advancement of nursing knowledge. Nursing Science Quarterly, 14 (2), 158. Volkmar, F. R., Chawarska, K., & Klin, A. (2005). Autism in infancy and early childhood. Annual Review of Psychology, 56, 315. Volkmar, F. R., & Klin, A. (2005). Issues in th e classification of autism and related conditions. In F. R. Volkmar, R. Paul, A. Klin, & D. Cohen (Eds.), Handbook of autism and pervasive developmental disorders: Vol. 1. Diagnosis, development, neurobiology, and behavior (3rd ed ., pp. 5). Hoboken, NJ: John Wiley & Sons, Inc. Volkmar, F. R., Lord, C., Bailey, A., Schultz, R. T., & Klin, A. (2004). Autism and pervasive developmental disorders. Journal of Child Psych ology and Psychiatry, 45 (1), 135. Wakefield, A. J., Murch, S. H., Anthony, A., Linnell, J., Casson, D. M. Malik, M. et al. (1998). Ileal-lymphoid-nodular hyperplasia, non-speci fic colitis, and pervasive developmental disorder in children. Lancet, 351, 637.

PAGE 138

138 Walco, G. A., Burns, J. P., & Cassidy, R. C. (2003). The ethics of pain control in infants and children. In N. L. Schechter, C. B. Berde & M. Yaster (Eds.), Pain in infants, children, and adolescents (2nd ed., pp. 157). Philadelphia: Lippincott Williams & Wilkins. Walker, D. R., Thompson, A., Zwaigenbaum, L., Go ldberg, J., Bryson, S. E., Mahoney, W. J., et al. (2004). Specifying PDD-NOS: A comparis on of PDD-NOS, aspe rger syndrome, and autism. Journal of the American Academy of Child and Adolescent Psychiatry, 43 (2), 172. Watzlawick, P., Beavin, J. H., & Jackson, D. D. (1967). The organization of human interaction. In Pragmatics of human communication (pp. 118). NY: W. W. Norton & Company. Williams, J. G., Higgins, J. P. T., & Brayne, C. E. G. (2006). Systematic review of prevalence studies of autism spectrum disorders. Archives of Disease in Childhood, 91, 8. Wood, J. T. (1982). Theory as a f oundation of human communication. In Human communication: A symbolic interactionist perspective (pp. 13). NY: Holt. World Health Organization. (1992). The ICD 10 Classification of Mental and behavioral Disorders: Clinical descript ions and diagnostic guidelines. Geneva, Switzerland: Author. Wynd, C. A., Schmidt, B., & Schaefer, M. A. (2003). Two quantitative approaches for estimating content validity. Western Journal of Nursing Research 25(5), 508. Zafeiriou, D. I., Ververi, A., & Vargiami, E. (2007). Childhood autism and associated comorbidities. Brain & Development, 29, 257. Zeltzer, L. K., & Schlank, C. B. (2005). Conquering your childs chroni c pain: A pediatricians guide for reclaiming a normal childhood. New York: HarperCollins Publishers, Inc.

PAGE 139

139 BIOGRAPHICAL SKETCH Melissa Kay Dodd Inglese was born on May 27, 1979 in Yokosuka, Japan. The daughter of a Navy dentist, Melissas trav els and early exposure to m edical practices and health concerns all over the world prompted her to pursue a career in nursing. Sh e graduated from the University of Florida in 2001, with a Bachelor of Science degree in nursing. Her developing passion for children led her to pursue adva nced degrees in nursing thro ugh the accelerated BSN-PhD program offered by the University of Florida. In 2002, Melissa received her Master of Science degree in nursing and began he r clinical work as a pediat ric nurse practitioner, while simultaneously continuing to pursue her doctoral degree. Melissas interests involve th e alleviation of suffering in vulnerable populations of children. Specifically, her clinical work focu ses on children with comp lex chronic conditions conditions requiring children and families to navi gate Americas vastly complex healthcare system. Her attention to proficient pain assessment and management in various pediatric populations led her to question how childre n with autism spectrum disorder (ASD)a population receiving national and international attentionexperience and express physical discomfort. Thus the focus of her doctoral wo rk was directed toward s this unique group of individuals. Melissa now continues her cl inical and academic work focused on serving vulnerable populations of children.