Few ideas for evaluation criteria guidelines document
In order to facilitate tomorrow's discussion, here are few ideas for
what to include in the evaluation criteria document.
1) checklist - proposed in 21-04-0152-03
a (detailed) map to the requirements document in order to catalog and
classify proposals and facilitate harmonization.
2) quantitative / qualitative performance measures - proposed in
21-04-0152-03
includes metrics that can be used to compare proposals in simulation,
analysis, or prototype implementation experiments:
overhead, delay, packet loss, complexity, deployment requirement,
interoperability
3) reference model/ architecture - proposed in 21-04-0152-03 & used in
21-04-0162
defines the handover optimizations in the context of known IP mobility
schemes:
Mobile IPv4, Mobile IPv6, FMIP, HMIP, SIP, others?
4) trigger events sequence diagram/flow chart - some example is given in
21-04-0162
could be constructed from proposed trigger events based on agreed upon
handover scenarios and options: Examples found in 21-04-0162 include:
- 802 to 3 GPPP: a) MS initiated/MS controlled, b) MS initiated/Network
controlled, c)Network initiated and controlled.
3GPPP to 802: a) MS initiated
- inter/intra 802
- others?
5) usage models/scenarios
these are used in most protocol performance analysis studies,
comparative and evaluation criteria documents and they typically include
some detailed descriptions in order for simulation and/or analytical
results to be compared and replicated. For example:
- application (traffic characterization): voice, video, file transfer, etc.
- network topology/configuration: user equipement (interface, power tx),
access network (number, type, distance, coverage area)
- mobility model: description of user path between from one access
network to the other.
- meta usage models that define parameters for the above elements: eg.
residential, office, airport, train., etc.
-nada
--
Nada Golmie, Ph.D.
Manager, High Speed Network Technologies Group
National Institute of Standards and Technology
100 Bureau Dr. Stop 8920
Gaithersburg, MD 20899
Email: nada@nist.gov
Phone: (301) 975-4190
Fax: (301) 590-0932
Web: http://w3.antd.nist.gov