1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
|
Network Working Group Tom O'Sullivan
Request for Comments: 313 Raytheon
NIC: 9343 March 6, 1972
(CBI: 1)
COMPUTER BASED INSTRUCTION
Current development of Computer Based Instruction (CBI) systems seem
to be directed toward two types of system:
1.) Small to medium scale, dedicated, stand alone systems (such
as the IBM 1130, 1500, 1800 complexes) or medium scale systems
with dedicated network implications (such as TICKET), and
2.) Large, centralized, dedicated systems with dedicated network
implications (such as PLATO).
Some attention has been given to the application of the resources of
a General Purpose Computer Network to CBI (e.g., the EDUCOM efforts),
however the full implication of the use of such resources do not
generally seem to be understood by either the CBI development centers
(at academic institutions or at the Armed Forces training or
development centers), where most of the current activity takes place,
or at ARPA Network Nodes, where most of the resources reside.
This Request For Comment has two purposes To:
1.) Solicit comments from the Network Working Group, and others,
on how selected classes of (and what specific) resources of a
General Purpose Network might be applied to the field of Computer
Based Instruction and
2.) Initiate a dialog between interested parties on the problems
of Computer Based Instruction, not limited to, but including, the
uses of General Purpose Computer Network resources.
The attached paper discusses some of the applications of the
resources of a large General Purpose Network to computer Based
Instruction systems. Response and discussion are encouraged through
the NIC system.
O'Sullivan [Page 1]
^L
RFC 313 Computer Based Instruction March 1972
GENERAL PURPOSE COMPUTER NETWORKS
AND
COMPUTER BASED INSTRUCTION
INTRODUCTION
A high level of Computer Based Instruction (CBI) activity exists both
in the academic and armed service communities, with the promise of a
substantial amount of early development of instruction courses and
instructional management facilities. The major functional areas of
interest can be described as follows:
1.) Design and Development
2.) Field Tests
3.) Distribution and Operational Use
4.) Evaluation and Modification
Specific computer support requirements are function of the philosophy
and reflected strategy of implementation for each of the functional
areas of interest. Design and development activities may focus on
overall curriculum development or on specific training or educational
goals involving a specific course. The focus of attention will have
an effect on the support requirements, e.g., the type and size of
data base, specialized processing capabilities, etc. Support
requirements for Field Tests will be a function of whether they are
to be performed at a central location, or are geographically
distributed, particularly with respect to data collection procedures,
computer support and terminal clusters, and communications.
Solutions to the problems of the distribution and operational use of
CBI systems and programs will be a function of the extent to which
the training activity is proliferated (i.e., geographically or
organizationally distributed). Both the level of activity, and the
solution to problems, in the area of Evaluation and Modification will
depend on the goals of the instructional process, the extent of
dynamic change in the technology or specific application involved,
and the degree to which the course(s) developed meet the needs for
which they were intended.
The above discussion has a heavy emphasis on Computer Aided
Instruction (CAI) component of CBI, where the computer is directly
used in the instructional process for lesson presentation, test,
drill and practice, etc. Another component of CBI, Computer Managed
Instruction (CMI), uses the computer as a management tool to guide
the instructional process. CMI may be used in conjunction with CAI,
or as an aid in guiding instructional processes of a more traditional
nature. CMI, in addition to providing assistance in student
selection, scheduling, and followup on past course performance, may
provide guidance to instructors in the form of diagnostics of student
O'Sullivan [Page 2]
^L
RFC 313 Computer Based Instruction March 1972
weaknesses, prescriptions for strengthening student understanding,
and guidance in the redirection of students. In addition, CMI can
provide management with evaluations of course and instructor
effectiveness. CMI has corollaries to the discussion of CAI resource
requirements and their relation to the philosophy and related
strategy employed.
Bearing in mind the effects on resource requirements of the complex
considerations involved in CBI, there seem to be several areas in
which the resources of a large General Purpose Computer Network, such
as the ARPA Network, could be of high utility if properly applied.
These include:
1.) The Network itself
2.) Centralized Data Storage
3.) Language processors
4.) Dialogue Support Systems
As questions of philosophy and general strategy are resolved, or
assumed, the hard questions of implementation come into play.
Tradeoffs between competing approaches of the instructional strategy
or model, techniques of measurement, languages, hardware, etc., must
be made. It appears that both in resolving the tradeoffs, and in the
implementation stage, network resources could prove to have high
utility.
THE NETWORK
The network itself seems to have utility for CBI that goes beyond the
function of providing a communications base for linking terminal(s)
(individual or clustered) to processors dedicated to CBI.
The latter function, however, is important. The communications
network exists, and can be tied into efficiently from many parts of
the country. If there were dedicated CBI systems on the network, it
would facilitate:
1.) Evaluation of a single system (or its several components) for
adequacy, or of competing systems for relative utility, by an
interested user center, to assist in the selection of a system for
a specific use;
2.) Early use by a geographically isolated user center, through
use of clustered terminals, of the full power of a major CBI
center,
O'Sullivan [Page 3]
^L
RFC 313 Computer Based Instruction March 1972
a.) For a continuing period of low level use, or
b.) Building over time until total usage by the isolated
center justifies the installation of a full CBI center of its
own.
Existing network resources also hold promise of utility. Many
manufacturers' systems, with associated varieties of operating system
software, are available on the ARPA Network. Within most of these, a
variety of application software is available, some supporting CBI and
data base applications. Therefore, even without the presence of a
dedicated CBI system available as a service center on the network,
use could be made in support of CBI interests.
1.) Testing of existing language and data base systems for
appropriateness to CBI problems.
2.) Development of CBI systems or components for demonstration
and/or test.
3.) Testing of existing courses, lessons, or lesson segments to
determine if they meet specified performance criteria, eliminating
potential duplication of course development effort.
4.) Development of CBI systems to be operated under a specific
set of hardware and software resources available in the network in
anticipation of delivery of a dedicated operational system.
5.) Greater flexibility in selection of test sites for field test
of courses developed, and performance of those tests prior to the
delivery of operational hardware.
6.) Formalization of hardware support and associated software
protocols to clustered terminals to provide continuing service to
geographically remote training activities.
Even the interests of dedicated CBI systems can be served, since the
network has established communications and terminal support protocols
that could tend to reduce the software efforts required to establish
contact between a large dedicated service center, and clusters of
user center terminals. In addition, terminal types not normally
supported by the CBI service center machine might be accommodated by
accessing the network through a compatible port, and getting into the
service center through established network protocols.
O'Sullivan [Page 4]
^L
RFC 313 Computer Based Instruction March 1972
Terminal access to the ARPA Network could be provided in the
following ways:
1.) Single Terminals - over common carrier facilities to the
nearest compatible HOST or TIP.
2.) Large Clusters - Simple single purpose TIP, or simple mini-
computer supported in the network as far distant HOST.
3.) Small clusters - either of the above two depending on the
length and intensity of expected use and the number or terminals
in the cluster.
In addition to the above general uses of a large General Purpose
Computer Network, there are several specific classes of network
resources that may be useful.
CENTRALIZED DATA STORAGE
The effect of economy of scale could reduce costs for smaller CBI
systems if they make use, through the network, of mass storage on
larger systems. If duplicate smaller systems are distributed in the
field, then the centralized storage would have a multiplying effect
on savings for lessons and lesson material, but special attention
would have to be given to the file structure to permit efficient use
of look ahead techniques for lessons, lesson segments, and individual
student pages.
For CMI data there are savings that go beyond the economy of scale.
A single management system could be selected or built on a large
service center machine to be used by CBI systems on the network, even
though the operational CBI systems are supported by different
manufacturers' hardware. This would not only reduce the cost for
programming and maintaining CMI systems, but also facilitate cross
system analysis and intersystem comparison, even though each using
system would have its own set of files. The user of the network data
reconfiguration service and data transfer protocol should make such
operations feasible.
This approach to CMI would assist in early development stages of
course material by easing the problem of accessing data on past
performance and norms. In the case of geographically distributed
testing, the evaluation team would have faster access to performance
data. Both the distribution and modification tasks seem cleaner
since there is only one copy of the released version to be updated.
If the trillion bit laser memory proposed for AMES becomes a reality,
then the economy of scale argument can be expected to be dramatic.
O'Sullivan [Page 5]
^L
RFC 313 Computer Based Instruction March 1972
LANGUAGE PROCESSORS
A basic characteristic of a large General Purpose Computer Network is
that it is capable of providing support from various manufacturers'
machines. That is, such a network can be comprised of a number of
special purpose processors that can be distributed geographically and
organizationally to locations where the best support exists for each
process.
This characteristic makes it possible to select and join the best
match of capabilities for a complex application . It is no longer
necessary to settle for a hardware/software system that does a
reasonable job in most areas of the applications need.
CBI is a complex application. In addition to a good management
system and associated data base, it requires heavy text handling for
lesson material, table lookup and branching logic for acting on the
student selected answers to multiple choice questions, a student
arithmetic problem solving language for drill and practice,
simulation capability of both physical processes (for laboratory and
circuit simulation), and of decision processes (for gaming
experience), and a future need for natural language processors to
permit evaluation of free form student responses. In addition, there
may be need for heavy statistical and arithmetic processing for
course, student, and instructor evaluation.
Depending on the course, various mixes of languages to support the
above activities will be needed. Some believe that the language
required for presentation of course material and evaluation of
student response (and associated appropriate action) may be heavily
dependent on the type of course being given. As we develop a deeper
understanding of the learning process, we are likely to require
expansion of languages to provide new functions and perform processes
not yet identified.
To provide expandability of languages, Meta-compiler techniques can
be applied. Meta-compilers are in an early stage of development;
however, several are available on the network. In addition to
facilitating language expansion with minimum effort while preserving
the workability of code written in the previous versions of the
changing language, the Meta-compiler can be made to produce either
compiler or program object code that will operate on several
different target machines. This feature can give both programs and,
in some cases, compilers that are transportable across machines,
eliminating the need to settle on a single manufacturer's hardware
when it is expected that a CBI compiler or interpreter, or a course
or set of courses is going to be used in a way that requires
O'Sullivan [Page 6]
^L
RFC 313 Computer Based Instruction March 1972
substantial geographic distribution. Hardware decisions can be based
on the most cost-effective hardware for the combinations to be run at
one time.
Use of Meta-compilers will permit the development and debugging of
new course material in advance of the delivery of the system selected
for operations, even though the selected machine is not yet
represented in the large General Purpose Computer Network. Field
test can also proceed before the selected hardware arrives.
Experience to date in the use of Meta-compilers indicates that the
use of their high order languages to implement compilers and
interpreters result in dramatic savings in both turnaround time and
the absolute cost of producing a finished language product.
DIALOGUE SUPPORT SYSTEMS
In a field developing as rapidly as CBI, and at a time when
substantial implementation is about to take place, dialogue between
theoreticians, developers, and users is an important issue. New
tools for supporting dialogue among members of a distributed group
are currently in experimental use in the ARPA network. These new
techniques not only support dialogue more rapidly than the
distribution of papers, notes, and memos, but in some cases tend to
sharpen the thought process and yield a better result.
The application of such facilities, when ready, will be helpful
beyond the early planning stages or projects. After plans are set,
during the development of a project, a broader group of experts will
be able to be called on to work on problems and questions as they
occur. Later, as the product is being field tested (especially if
testing is distributed or separated from the evaluation group), these
new tools can be used to allow the test implementors to interact with
each other and with evaluators in a more timely manner than a post-
mortum meeting, resolving problems and questions as they occur, and
as a side benefit producing more complete documentation of test
progress.
After the tests, when the product is being used operationally, these
same tools can provide an excellent vehicle for tapping the ideas,
suggestions, and enrichments contributed by the more creative
instructors, and facilitate acting on them more rapidly than is
currently possible.
Meanwhile, as these tools are being developed, present ARPA Network
procedures for supporting the dialogue in a distributed group in more
traditional ways may prove helpful. The Network Information Center
(NIC), in addition to supporting the general ARPANET community, is
O'Sullivan [Page 7]
^L
RFC 313 Computer Based Instruction March 1972
supporting special interest groups such as the Speech Understanding
Research (SUR) group. The application of these procedures could
establish a valuable link between the academic-nonprofit institutions
working on CBI, the centers in the Armed Forces where development and
operations are taking place, and members of the network community who
have an intimate understanding of the network resources available.
CONCLUSION
This paper has argued that there are resources in a large General
Purpose Computer Network that can be applied to CBI with high
utility. The argument can be extended to suggest that large
dedicated CBI systems can have greater utility to users (and in the
other direction, greater use), if tied into a General Purpose
Computer Network, with respect to current network capabilities,
future network developments, and in some cases provide backup during
periods of overload or system failure.
There are certainly important CBI issues outstanding in areas of
pedagogy, strategy, curriculum development, testing, etc. As CBI
systems are developed there are important issues of control (of the
development process, of the distribution of material, and of
modification of those materials). However, these issues seem to be
independent of the question of whether CBI takes advantage of the
resources of a large General Purpose Network.
There are important problems to be solved on the computer side
dealing with better tools to handle and evaluate masses of data,
language, and protocols for network utilization.
However, there seems to be sufficient promise in what we know of
present network capabilities to warrant serious consideration by the
developers of CBI of how General Purpose Networks fit in, and by
network people of how their resources apply to this important large
application area.
[This RFC was put into machine readable form for entry]
[into the online RFC archives by H�l�ne Morin, Viag�nie 10/99]
O'Sullivan [Page 8]
^L
|