• Title/Summary/Keyword: Calibration and Validation

Search Result 649, Processing Time 0.19 seconds

Development of the Algorithm for Optimizing Wavelength Selection in Multiple Linear Regression

  • Hoeil Chung
    • Near Infrared Analysis
    • /
    • v.1 no.1
    • /
    • pp.1-7
    • /
    • 2000
  • A convenient algorithm for optimizing wavelength selection in multiple linear regression (MLR) has been developed. MOP (MLP Optimization Program) has been developed to test all possible MLR calibration models in a given spectral range and finally find an optimal MLR model with external validation capability. MOP generates all calibration models from all possible combinations of wavelength, and simultaneously calculates SEC (Standard Error of Calibration) and SEV (Standard Error of Validation) by predicting samples in a validation data set. Finally, with determined SEC and SEV, it calculates another parameter called SAD (Sum of SEC, SEV, and Absolute Difference between SEC and SEV: sum(SEC+SEV+Abs(SEC-SEV)). SAD is an useful parameter to find an optimal calibration model without over-fitting by simultaneously evaluating SEC, SEV, and difference of error between calibration and validation. The calibration model corresponding to the smallest SAD value is chosen as an optimum because the errors in both calibration and validation are minimal as well as similar in scale. To evaluate the capability of MOP, the determination of benzene content in unleaded gasoline has been examined. MOP successfully found the optimal calibration model and showed the better calibration and independent prediction performance compared to conventional MLR calibration.

Simulation of Sediment Yield from Imha Watershed Using HSPF (HSPF를 이용한 임하호 유역 유사량 모의)

  • Jeon, Ji-Hong
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.52 no.6
    • /
    • pp.39-48
    • /
    • 2010
  • Sediment yields from Imha watershed were simulated during 1993-2008 using Hydrologic Simulation Program-Fortran (HSPF). Using observed daily stream flow for 2004-2008 and hourly suspended solid concentration for three events during 2006, HSPF was calibrated and validated at the sites of Imha and Youngyang for stream flow and Dongchun and Jangpachun for sediment yield. The calibration and validation results represented high model efficiency for simulating daily stream flow and hourly suspended solid. The determination coefficients of calibration and validation were 0.90 and 0.81 for daily stream flow, and 0.91 and 0.86 for monthly stream flow, respectively. Based on model tolerances for calibration and validation of stream flow, HSPF performance for simulating stream flow represented 'very good'. The determination coefficients of calibration and validation were 0.94-0.96 and 0.95 for hourly sediment yields, respectively. The average yearly sediment yield during 1993-2008 was 122,290 ton/year and most of sediment yield (77 % of total yield) were generated from June to August. The calibrated HSPF simulated well the movement of water and eroded soil within Imha watershed.

Calibration of APEX-Paddy Model using Experimental Field Data

  • Mohammad, Kamruzzaman;Hwang, Syewoon;Cho, Jaepil;Choi, Soon-Kun;Park, Chanwoo
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2019.05a
    • /
    • pp.155-155
    • /
    • 2019
  • The Agricultural Policy/Environmental eXtender (APEX) models have been developed for assessing agricultural management efforts and their effects on soil and water at the field scale as well as more complex multi-subarea landscapes, whole farms, and watersheds. National Academy of Agricultural Sciences, Wanju, Korea, has modified a key component of APEX application, named APEX-Paddy for simulating water quality with considering appropriate paddy management practices, such as puddling and flood irrigation management. Calibration and validation are an anticipated step before any model application. Simple techniques are essential to assess whether or not a parameter should be adjusted for calibration. However, very few study has been done to evaluate the ability of APEX-Paddy to simulate the impact of multiple management scenarios on nutrients loss. In this study, the observation data from experimental fields at Iksan in South Kora was used in calibration and evaluation process during 2013-2015. The APEX auto- calibration tool (APEX-CUTE) was used for model calibration and sensitivity analysis. Four quantitative statistics, the coefficient of determination ($R^2$),Nash-Sutcliffe(NSE),percentbias(PBIAS)androotmeansquareerror(RMSE)were used in model evaluation. In this study, the hydrological process of the modified model, APEX-Paddy, is being calibrated and tested in predicting runoff discharge rate and nutrient yield. Field-scale calibration and validation processes are described with an emphasis on essential calibration parameters and direction regarding logical sequences of calibration steps. This study helps to understand the calibration and validation way is further provided for applications of APEX-Paddy at the field scales.

  • PDF

Calibration and Validation Activities for Earth Observation Mission Future Evolution for GMES

  • LECOMTE Pascal
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.237-240
    • /
    • 2005
  • Calibration and Validation are major element of any space borne Earth Observation Mission. These activities are the major objective of the commissioning phases but routine activities shall be maintained during the whole mission in order to maintain the quality of the product delivered to the users or at least to fully characterise the evolution with time of the product quality. With the launch of ERS-l in 1991, the European Space Agency decided to put in place a group dedicated to these activities, along with the daily monitoring of the product quality for anomaly detection and algorithm evolution. These four elements are all strongly linked together. Today this group is fully responsible for the monitoring of two ESA missions, ERS-2 and Envisat, for a total of 12 instruments of various types, preparing itself for the Earth Explorer series of five. other satellites (Cryosat, Goce, SMOS, ADM-Aeolus, Swarm) and at various levels in past and future Third Party Missions such as Landsat, J-ERS, ALOS and KOMPSAT. The Joint proposal by the European Union and the European Space Agency for a 'Global Monitoring for Environment and Security' project (GMES), triggers a review of the scope of these activities in a much wider framework than the handling of single missions with specific tools, methods and activities. Because of the global objective of this proposal, it is necessary to put in place Multi-Mission Calibration and Validation systems and procedures. GMES Calibration and Validation activities will rely on multi source data access, interoperability, long-term data preservation, and definition standards to facilitate the above objectives. The scope of this presentation is to give an overview of the current Calibration and Validation activities at ESA, and the planned evolution in the context of GMES.

  • PDF

Automatic RF Input Power Level Control Methodology for SAR Measurement Validation

  • Kim, Ki-Hwea;Choi, Dong-Geun;Gimm, Yoon-Myoung
    • Journal of electromagnetic engineering and science
    • /
    • v.15 no.3
    • /
    • pp.181-184
    • /
    • 2015
  • Evaluation of radiating radiofrequency fields from hand-held and body-mounted wireless communication devices to human bodies are conducted by measuring the specific absorption rate (SAR). The uncertainty of system validation and probe calibration in SAR measurement depend on the variation of RF power used for the validation and calibration. RF input power for system validation or probe calibration is controlled manually during the test process of the existing systems in the laboratories. Consequently, a long time is required to reach the stable power needed for testing that will cause less uncertainty. The standard uncertainty due to this power drift is typically 2.89%, which can be obtained by applying IEC 62209 in a normal operating condition. The principle of the Automatic Input Power Level Control System (AIPLC), which controls the equipment by a program that maintains a stable input power level, is suggested in this paper. The power drift is reduced to less than ${\pm}1.16dB$ by AIPLC, which reduces the standard uncertainty of power drift to 0.67%.

Study on Improvement of Calibration/Validation of SWAT for Spatio-Temporal Analysis of Land Uses and Rainfall Patterns (강수패턴과 토지이용의 시공간적 분석을 위한 SWAT모형의 검보정 개선방안 연구)

  • Lee, Ji-Won;Kum, Donghyuk;Kim, Bomchul;Kim, Young Sug;Jeong, Gyo-Cheol;Kim, Ki-Sung;Choi, Joong-Dae;Lim, Kyoung Jae
    • Journal of Korean Society on Water Environment
    • /
    • v.29 no.3
    • /
    • pp.365-376
    • /
    • 2013
  • The purpose of this study was to evaluate effects of spatio-temporal changes in land uses and rainfall magnitude using the Soil and Water Assessment Tool (SWAT). Prior of application of the model to real-world problem, the model should be calibrated and validated properly. In most modeling approaches, the validation process is done assuming no significant changes occurring at the study watershed between calibration and validation periods, which is not proper assumption for agricultural watersheds. If simulated results obtained with calibrated parameters match observed data with higher accuracy for validation period, this does not always mean the simulated result represents rainfall-runoff, pollutant generation and transport mechanism for validation period because temporal and spatial variables and rainfall magnitude are often not the same. In this study SWAT was applied to Mandae study watershed in Korea to evaluate effects of spatio-temporal changes in landuses using 2009 and 2010 crop data for each field at the watershed. The Nash-Sutcliffe model efficiency (NSE) values for calibration and validation with either 2009 or 2010 was evaluated and the NSE value for calibration with 2009 and calibration with 2010 were compared. It was found that if there is substantial change in land use and rainfall, model calibration period should be determined to reflect those changes. Through these approaches, inherent limitation of the SWAT, which does not consider changes in land uses over the simulation period, was investigated. Also, Effects of changes in rainfall magnitude during calibration process were analyzed.

Nondestructive Quantification of Intact Ambroxol Tablet using Near-infrared Spectroscopy (근적외분광분석법을 사용한 암브록솔 정제의 비파괴적 정량분석)

  • 임현량;우영아;김도형;김효진;강신정;최현철;최한곤
    • YAKHAK HOEJI
    • /
    • v.48 no.1
    • /
    • pp.60-64
    • /
    • 2004
  • Near-infrared (NIR) spectroscopy was used to determine rapidly and nondestructively the content of ambroxol in intact ambroxol tablets containing 30 mg (12.5% m/m nominal concentration) by collecting NIR spectra in range 1100-1750 nm. The laboratory-made samples had 10.3∼15.9% m/m nominal ambroxol concentration. The measurements were made by reflection using a fiber-optic probe and calibration was carried out by partial least square regression (PLSR) with autoscaling. Model validation was performed by randomly splitting the data set into calibration and validation data set (7 samples as a calibration data set and 5 samples as a validation data set). The developed NIR method gave results comparable to the known values of tablets in a laboratorial manufacturing Process, standard error of calibration (SEC) and standard error of prediction (SEP) being 0.49% and 0.49% m/m respectively. The method showed good accuracy and repeatability NIR spectroscopic determination in intact tablets allowed the potential use of real time monitoring for a running production process.

COMPARISON OF LINEAR AND NON-LINEAR NIR CALIBRATION METHODS USING LARGE FORAGE DATABASES

  • Berzaghi, Paolo;Flinn, Peter C.;Dardenne, Pierre;Lagerholm, Martin;Shenk, John S.;Westerhaus, Mark O.;Cowe, Ian A.
    • Proceedings of the Korean Society of Near Infrared Spectroscopy Conference
    • /
    • 2001.06a
    • /
    • pp.1141-1141
    • /
    • 2001
  • The aim of the study was to evaluate the performance of 3 calibration methods, modified partial least squares (MPLS), local PLS (LOCAL) and artificial neural network (ANN) on the prediction of chemical composition of forages, using a large NIR database. The study used forage samples (n=25,977) from Australia, Europe (Belgium, Germany, Italy and Sweden) and North America (Canada and U.S.A) with information relative to moisture, crude protein and neutral detergent fibre content. The spectra of the samples were collected with 10 different Foss NIR Systems instruments, which were either standardized or not standardized to one master instrument. The spectra were trimmed to a wavelength range between 1100 and 2498 nm. Two data sets, one standardized (IVAL) and the other not standardized (SVAL) were used as independent validation sets, but 10% of both sets were omitted and kept for later expansion of the calibration database. The remaining samples were combined into one database (n=21,696), which was split into 75% calibration (CALBASE) and 25% validation (VALBASE). The chemical components in the 3 validation data sets were predicted with each model derived from CALBASE using the calibration database before and after it was expanded with 10% of the samples from IVAL and SVAL data sets. Calibration performance was evaluated using standard error of prediction corrected for bias (SEP(C)), bias, slope and R2. None of the models appeared to be consistently better across all validation sets. VALBASE was predicted well by all models, with smaller SEP(C) and bias values than for IVAL and SVAL. This was not surprising as VALBASE was selected from the calibration database and it had a sample population similar to CALBASE, whereas IVAL and SVAL were completely independent validation sets. In most cases, Local and ANN models, but not modified PLS, showed considerable improvement in the prediction of IVAL and SVAL after the calibration database had been expanded with the 10% samples of IVAL and SVAL reserved for calibration expansion. The effects of sample processing, instrument standardization and differences in reference procedure were partially confounded in the validation sets, so it was not possible to determine which factors were most important. Further work on the development of large databases must address the problems of standardization of instruments, harmonization and standardization of laboratory procedures and even more importantly, the definition of the database population.

  • PDF

A Analysis for Calibration Site Selection of SAR Satellite (SAR 위성 검보정 사이트 선택을 위한 분석)

  • Keum, Jung-Hoon;Ra, Sung-Woong
    • Journal of Astronomy and Space Sciences
    • /
    • v.26 no.4
    • /
    • pp.659-666
    • /
    • 2009
  • CALVAL (Calibration & Validation) shall consider payloads characteristics because satellites have one and/or several payloads in order to perform their various missions. SAR satellite, one of various satellite, shall need to use special ground targets, which can reflect the radar signal to the satellite, because it can see objects with reflected radar signal. Therefore, the special ground targets, which are called generally reflector(corner reflector is the one of them) shall be installed and constructed on the ground path. The satellite must access the targets on that path. To accomplish successful calibration, the CALVAL site including corner reflectors will be surveyed and analyzed using various environment characteristics. In this paper, CALVAL site including point targets(corner reflector) for absolute radiometric calibration except one including distributed targets for relative radiometric calibration has been deeply considered.

Estimation of the Hapcheon Dam Inflow Using HSPF Model (HSPF 모형을 이용한 합천댐 유입량 추정)

  • Cho, Hyun Kyung;Kim, Sang Min
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.61 no.5
    • /
    • pp.69-77
    • /
    • 2019
  • The objective of this study was to calibrate and validate the HSPF (Hydrological Simulation Program-Fortran) model for estimating the runoff of the Hapcheon dam watershed. Spatial data, such as watershed, stream, land use, and a digital elevation map, were used as input data for the HSPF model. Observed runoff data from 2000 to 2016 in study watershed were used for calibration and validation. Hydrologic parameters for runoff calibration were selected based on the user's manual and references, and trial and error method was used for parameter calibration. The $R^2$, RMSE (root-mean-square error), RMAE (relative mean absolute error), and NSE (Nash-Sutcliffe efficiency coefficient) were used to evaluate the model's performance. Calibration and validation results showed that annual mean runoff was within ${\pm}4%$ error. The model performance criteria for calibration and validation showed that $R^2$ was in the rang of 0.78 to 0.83, RMSE was 2.55 to 2.76 mm/day, RMAE was 0.46 to 0.48 mm/day, and NSE was 0.81 to 0.82 for daily runoff. The amount of inflow to Hapcheon Dam was calculated from the calibrated HSPF model and the result was compared with observed inflow, which was -0.9% error. As a result of analyzing the relation between inflow and storage capacity, it was found that as the inflow increases, the storage increases, and when the inflow decreases, the storage also decreases. As a result of correlation between inflow and storage, $R^2$ of the measured inflow and storage was 0.67, and the simulated inflow and storage was 0.61.