UFDC Home  

PAGE 1

2002 September --ejk/UFRESEARCH TOPICSWeb-Interface PerformanceDTD ExtensibilityImagingDistillationOther topics?

PAGE 2

2002 September --ejk/UFCONTEXT Image Only Pilots •Australian Periodical Publications, 1840-1845 •National Library of New Zealand. Papers Past Image & Indexing/Tagging Pilot •University of Florida. Caribbean Newspaper Imaging Project •University of Florida. Florida Newspaper Project Image & OCR Pilots •Lambrakis Press Archives •ProQuest. Historical Newspapers™ •TIDEN Project : a Nordic Digital Newspaper Library Olive Software Pilot •The British Library

PAGE 3

2002 September --ejk/UFWEB-INTERFACE PERFORMANACE Primary Purpose: •Characterize the bias of individuals conducting study Products: • How to use ActivePaperTMto Your Advantage •Integration with CONTENTdm, XPAT 5.0, other •Alternate deliverable images •Centralized service –Distributed content –Variable platforms

PAGE 4

2002 September --ejk/UFDTD EXTENSIBILITY Primary Purpose: •Assess the XML against established newspaper uses Products: • How to use ActivePaperTM to Your Advantage •Document the XML as a public DTD •Establish a maintenance authority •Provide for extension of the DTD •Automation for extended tagging •How to construct a style sheet •Integration with CONTENTdm, XPAT 5.0, other •Define issues per the Economic Model

PAGE 5

2002 September --ejk/UFIMAGING • Directory Structure and File Naming • Archival Formats • Optimized Imaging

PAGE 6

2002 September --ejk/UFIMAGING: Directory Structure and File Naming Primary Purpose: •Recommended practices Products: •Methods for dealing with anomalies •Automated name capture during imaging

PAGE 7

2002 September --ejk/UFIMAGING: Archival Formats Primary Purpose: •Description of file formats & their characteristics for archive, distillation, and distribution Products: •Preservation metadata •Anticipate migration •Schedule & fee structure for inspection & migration •Strategy for format migrations & emulation

PAGE 8

2002 September --ejk/UFIMAGING: Optimized Imaging Primary Purpose: •Best practices for microfilming and digitizing ( quantitative assessments ) •Film reduction ratio •Evenness of illumination on film •Film background density •Quality Index & DPI/PPI •Skew •Color-space & Bit-depth •Image density/black & white points •Despeckling and Sharpening •Image restoration methods

PAGE 9

2002 September --ejk/UFIMAGING: Optimized Imaging Environments: •Operating System •Scanning Hardware •Lighting and Light Filtration •Post-processing •Other? Other Products: •Control target for OCR assessment •Revision: RLG Preservation Microfilming Guidelines

PAGE 10

2002 September --ejk/UFDISTILLATION • Document Zoning • Optical Character Recognition

PAGE 11

2002 September --ejk/UFDISTILLATION: Document Zoning Primary Purpose: •Confirm assumptions re: document zoning • OCR has difficulty processing large letters •Smaller zone yield more accurate text Products: •Establish reference to the . •PDF ( fully scaled ) •TIFF •Other derivative file formats ( fully scaled )

PAGE 12

2002 September --ejk/UFDISTILLATION: OCR Primary Purpose: •Provide quantitative OCR accuracy information Areas of Investigation: •Distillation Source Images •Language and Fonts •Column & Line Density •Relative Density/Contrast •Text Curvature and Other Defects

PAGE 13

2002 September --ejk/UFDISTILLATION: OCR Primary Purpose: •Predict accuracy contingent upon source document ( printing technologies & filming standards ) Test-Set Characterization: •Source type ( newspaper or microfilm ) •Production date ( technologies & standards used ) AdditionalProducts: •Best practices •Accuracy : Cost –MatrixDistillation Source Images

PAGE 14

2002 September --ejk/UFDISTILLATION: OCR Language and FontsPrimary Purpose: •Demonstrate ability to distill languages, character sets & fonts Test-Set Characterization: •Language & character set groups •Font face & font size groups •Regional variant spellings Additional Products: • Olive Software Speaks Your Language • How Olive Software Learns Your Lingo •Stylized text recognition & distillation guide

PAGE 15

2002 September --ejk/UFDISTILLATION: OCR Column & Line DensityPrimary Purpose: •Demonstrate ability to distill compact text Test-Set Characterization: •Pre-1900 newspapers •Advertisement pages •Pages predominantly 8 pt. type or less •Pages with less than 1 mm space between lines •Pages with characters spaced at or below mm

PAGE 16

2002 September --ejk/UFDISTILLATION: OCR Relative Density/ContrastPrimary Purpose: •Investigate low and uneven contrast materials Test-Set Characterization: •Low contrast pages •Pages with low contrast zones •Printing, Filming, & Age/Storage Defects AdditionalProducts: •Best practices •Accuracy : Cost –Matrix • Don’t forget to buy the Life Insurance

PAGE 17

2002 September --ejk/UFDISTILLATION: OCR Text Curvature and Other DefectsPrimary Purpose: •Benchmark current capability to distill curved text & other defects of printing or filming Test-Set Characterization: •Curved text zones •Broken character zones •Broken line zones •Garbage elements ( stains, etc .) AdditionalProducts: •(Additional automatic image correction processes)


STANDARD VIEW MARC VIEW
Permanent Link: http://ufdc.ufl.edu/UF00094075/00005
 Material Information
Title: Presentation on CNIP (2002)
Physical Description: Book
Language: English
Creator: George A. Smathers Libraries, University of Florida
Phillips, Richard
Ingram, John
Kesse, Erich
Botero, Cecilia
Publisher: George A. Smathers Libraries, University of Florida
Place of Publication: Gainesville, Fla.
Publication Date: 2002
 Subjects
Genre:
Spatial Coverage:
 Notes
Abstract: The Caribbean Newspaper Imaging Project was a series of demonstration projects, both funded by the Andrew W. Mellon Foundation and the University of Florida Libraries. These projects occurred as two distinct phases: Phase One: Imaging and Indexing Model. A feasibility studies for imaging and indexing. The imaging study examined the efficacy of digitizing microfilms produced in advance of current preservation microfilming standards. It also examined the use of off-the-shelf microfilm-projection scanning, as well as associated costs, benefits and drawbacks. The indexing study examined indexing procedures, application of controlled terminology, and the costs associated with multi-lingual term assignments by human readers. Phase Two: OCR Gateway to Indexing. A feasibility study on the application of Optical Character Recognition (OCR). In its current state, the Project is undergoing technological renovation, that is migration from CD-ROM to Internet delivery. At the same time, the Project is developing plans for additional content.
 Record Information
Source Institution: University of Florida
Holding Location: University of Florida
Rights Management: All rights reserved by the source institution and holding location.
System ID: UF00094075:00005


This item has the following downloads:

( PPT )

( PDF )


Full Text



RESEARCH TOPICS


* Web-Interface Performance

* DTD Extensibility

* Imaging

* Distillation


m Other topics?


ABCDl
EFGH
, IJKL
MNOP
SQRST
!UVWX
YZ


2002 September -- ejk/UF








CONTEXT


Image Only Pilots
Australian Periodical Publications, 1840-1845
National Library of New Zealand. Papers Past
Image & Indexing/Tagging Pilot
University of Florida. Caribbean Newspaper Imaging Project
University of Florida. Florida Newspaper Project
Image & OCR Pilots
Lambrakis Press Archives
ProQuest. Historical NewspapersTM
TIDEN Project : a Nordic Digital Newspaper Library
Olive Software Pilot
The British Library


2002 September -- ejk/UF








WEB-INTERFACE PERFORMANCE



Primary Purpose:
Characterize the bias of individuals conducting study


Products:
How to use ActivePaperTM to YourAdvantage
Integration with CONTENTdm, XPAT 5.0, other
Alternate deliverable images
Centralized service Distributed content Variable platforms


2002 September -- ejk/UF








DTD EXTENSIBILITY



Primary Purpose:
Assess the XML against established newspaper uses


Products:
How to use ActivePaperTM to YourAdvantage
Document the XML as a public DTD
Establish a maintenance authority
Provide for extension of the DTD
Automation for extended tagging
How to construct a style sheet
Integration with CONTENTdm, XPAT 5.0, other
Define issues per the Economic Model


2002 September -- ejk/UF








IMAGING



Directory Structure and File Naming
Archival Formats
Optimized Imaging


2002 September -- ejk/UF








IMAGING: Directory Structure and File Naming



Primary Purpose:
Recommended practices


Products:
Methods for dealing with anomalies
Automated name capture during imaging


2002 September -- ejk/UF








IMAGING: Archival Formats


Primary Purpose:
Description of file formats & their characteristics
for archive, distillation, and distribution


Products:
Preservation metadata
Anticipate migration
Schedule & fee structure for inspection
& migration
Strategy for format migrations & emulation


2002 September -- ejk/UF








IMAGING: Optimized Imaging


Primary Purpose:
SBest practices for microfilming and digitizing
(quantitative assessments)
Film reduction ratio
Evenness of illumination on film
Film background density
Quality Index & DPI/PPI
Skew
Color-space & Bit-depth
Image density/black & white points
Despeckling and Sharpening
Image restoration methods


2002 September -- ejk/UF








IMAGING: Optimized Imaging


Environments:
Operating System
Scanning Hardware
Lighting and Light Filtration
Post-processing

Other?


Other Products:
Control target for OCR assessment
Revision: RLG Preservation Microfilming Guidelines


2002 September -- ejk/UF








DISTILLATION


Document Zoning
Optical Character Recognition

ABCD
EFGH1
MNOP
QRIST
iUVWX
YZ


ABCD
EFGH'
IJKL
'MNOP,
QRST
.UVWX
YZ
2002 September -- ejk/UF








DISTILLATION:


Document Zoning


Primary Purpose:


Confirm assumptions re: document zoning
OCR has difficulty processing large letters
Smaller zone yield more accurate text


Products:
Establish reference to the ...
PDF (fully scaled)
TIFF
Other derivative file formats (fully scaled)


2002 September -- ejk/UF


ABCD
EFGH H
IJKL
MN OP1
OQRST
VUVWX
Uy7w
YZ


ABCDI
EFGH'
I J KL
'MNOP
QRST
UVWX
YZ








DISTILLATION: OCR


Primary Purpose:


* Provide quantitative OCR accuracy information


Areas of Investigation:
Distillation Source Images
Language and Fonts
Column & Line Density
Relative Density/Contrast
Text Curvature and Other Defects


2002 September -- ejk/UF


ABCD
EFGH :
IJKL
MNOP
QRST
UVWX



ABCDI
EFGH'
IJKL
'MNOP,
QRST
UVWX
YZ








DISTILLATION:


OCR


Distillation Source Images


ABCD
EFGH:
IJKL
MNOPR
jQRST
UVWX
YZ
i Y-ZJ'4 Ti
i 1~U 'IPT) '


Primary Purpose:
Predict accuracy contingent upon source document
(printing technologies & filming standards)

Test-Set Characterization:
Source type (newspaper or microfilm)
Production date (technologies & standards used)

Additional Products:
Best practices
Accuracy : Cost Matrix


2002 September -- ejk/UF


ABCD1
EFGH'
IJKL
;MNOP1
QRST
!UVWX
YZ








DISTILLATION: OCR
Language and Fonts


Primary Purpose:
Demonstrate ability to distill languages, character sets
& fonts

Test-Set Characterization:
Language & character set groups
Font face & font size groups
Regional variant spellings

Additional Products:
Olive Software Speaks Your Language
How Olive Software Learns Your Lingo
Stylized text recognition & distillation guide


2002 September -- ejk/UF


ABCD
EFGH:
IJKL
MNOPt
QRSTB
UVWX
YZ
-Z '
i 1~U 'IPT) '


ABCD1
EFGH'
IJKL
MNOP,
Q RST
!UVWX
YZ








DISTILLATION: OCR
Column & Line Density


Primary Purpose:
Demonstrate ability to distill compact text

Test-Set Characterization:
Pre-1900 newspapers
Advertisement pages
Pages predominantly 8 pt. type or less
Pages with less than 1 mm space between lines
Pages with characters spaced at or below mm


2002 September -- ejk/UF


ABCD
EFGH:
IJKL
MNOPR
QRSTB
VUVWX
YZ
- -' - -
i 1~U 'IPT) '


ABCD1
EFGH'
IJKL
M NOP,
Q RST
_UVWX
YZ








DISTILLATION: OCR
Relative Density/Contrast


Primary Purpose:
Investigate low and uneven contrast materials

Test-Set Characterization:
Low contrast pages
Pages with low contrast zones
Printing, Filming, & Age/Storage Defects

Additional Products:
Best practices
Accuracy : Cost Matrix
Don't forget to buy the Life Insurance


2002 September -- ejk/UF


ABCD
EFGH:
IJKL
MNOPR
QRSTB
YUVWX
SY -Z' I
i 1~U 'IPT) '


ABCD1
EFGH'
:MNOP,
Q RST
_UVWX
YZ


E








DISTILLATION:


OCR


Text Curvature and Other Defects


Primary Purpose:
Benchmark current capability to distill curved text
& other defects of printing or filming

Test-Set Characterization:
Curved text zones
Broken character zones
Broken line zones
Garbage elements (stains, etc.)

Additional Products:
(Additional automatic image correction processes)


2002 September -- ejk/UF


ABCD
EFGH:
IJK L
MNOPt
QjRST
UVWX
YZ
-ZJ'
i eb,] ~1~4 T i


ABCD1
EFGH'
IJKL
M NOP
Q RST
UVWX
YZ




  Home | About dLOC | Collections | Governance | Digitization | Outreach | Contact  
  Powered by SobekCM
Acceptable Use, Copyright, and Disclaimer Statement  
© All rights reserved