Modification of CSE-UCLA Model Using Weighted Product in Optimizing Digital Library of Learning Support

ABSTRACT


INTRODUCTION
The current study process is inseparable from the development of information technology.This happens because the learning strategies, learning model or supporting facilities learning process based on information technology is widely applied in schools or colleges in various forms such as: e-learning, digital libraries, e-teaching, and more.These statements have the same perception with the results of research that has been conducted by Divayana, Suyasa and Sugihartini [1] stating that the development of the world of education can greatly facilitated through a variety of learning models utilizing information technology, such as: e-teaching, computer based instruction, and e-learning.
However, advances in information technology remains won't be able to replace completely the role of educators in making the learners as intelligent beings and behave well through wisdom arising from the experience shared by educators.Information technology can facilitate the needs probably just supporting, such as for example digital learning materials, digital library, and other needs in the learning process, but the experiences of educators in addressing the problems-problems/difficulties found in the learning process that concerns the realm of attitude or motivation of lear ning are certainly very difficult resolved through the help of information technology.
It is well known with that until the current developments and advances in information technology can only be used to help support the learning process and can not replace completely the duties and calculations as recommendations that can be used by the Head of Library in universities in making decisions/policies in order to optimize digital library services.
Based on the problems and general solutions offered to solve the problem, it can be clarified problem formulation in this research is: "How form and application of CSE-UCLA evaluation model modified with weighted product method?".Based on the formulation of these problems, generally the main purpose of this research is to know the application form of CSE-UCLA evaluation model which has been modified using weighted product method and the simulation of its application in evaluating the digital library service in computer colleges in Bali.
This research is a second year research based on the result of research which has been implemented by Divayana, Adiarta, and Abadi before in 2017.In the first year research has been produced the design of CSE-UCLA evaluation model modified by weighted product method [4].However, the limitations found in the first year are limited to the design of the design and limited trials of the design which involves only two educational experts and 2 informatics experts.This research is also based on the obstacles found from self-directed research conducted by Divayana [17], where the results show that the evaluation application of digital library is still static, so that it will have difficulties if new evaluation aspect is needed.

RESEARCH METHOD
The research was carried out using R & D research (Development and Development) research method, with Borg and Gall model design which has 10 stages, including [4]: 1) research and field data collection, 2) planning research, 3) design development, 4) initial test , 5) revision of initial test results, 6) field trials, 7) field trial revisions, 8) trial usage, 9) final product revisions, and 10) dissemination and final product implementation.
In the first year implemented five stages, including: 1) research and field data collection, 2) planning research, 3) design development, 4) initial test, and 5) revision of initial test results.Meanwhile, in the second year implemented the application to realize the model design that has been produced in previous years to be ready field tested.Research subjects involved for field trials in this second year as much as 2 education experts, 2 informatics experts, and 10 evaluators.Selection of research subjects using purposive sampling technique.The location of this research was carried out in several existing computer colleges in Bali Province.Instruments used in collecting data in the form of questionnaires, interview guides, and documentation.The analysis technique that was used in this research was descriptive statistic.

RESULTS AND ANALYSIS
This research has obtained the result of application based on CSE-UCLA evaluation model that has been modified with weighted product and for field test result in this paper only explained with simulation of field trials conducted by 4 respondents.As a general view of the application based on CSE-UCLA evaluation model that has been modified, can be seen in Figure 1-3.The display of main menu shown in Figure 1 is used as navigation to the page/other forms.The display of main menu has four pointers located on the menu bar.The display of main menu is also decorated with the design of the image according to the evaluation theme of digital library services.

Figure 2. Display of weighted product calculation form
The display of weighted product calculation form shown in Figure 2 is used to facilitate the calculation process by weighted product method.In this form is available textbox that is used to input the weight value of the decision maker and input the average value of each aspect automatically.In this form is also available button to perform the calculation process automatically, so it can display the value of vector S as the value of normalization process and Vektos V as the basis of ranking value.The display of evaluation results form shown in Figure 3 above is used to facilitate the display of evaluation results.The form consists of texbox used to display the vector-V value and evaluation components, while the text area is used to display evaluation and recommendation constraints.
The simulation of field trials conducted by 4 respondents i.e. 2 education experts and 2 informatics experts can be explained as follows: If known results of field questionnaire filling questionnaire on the application of CSE-UCLA evaluation model modified by the weighted product method, which conducted by 4 respondents can be shown in Table 1 A1 : Legal foundation of the digital libraries implementation A2 : Vision of the digital libraries implementation A3 : Mission of the digital libraries implementation A4 : Objectives of the digital libraries implementation A5 : Benefits of the digital libraries implementation A6 : Needs of digital library management staff support A7 : Support from the entire academic community colleges A8 : Organization structure of digital library management A9 : The readiness of lecturers' ability in using digital library service A10 : The readiness of students' ability in using digital library service A11 : The readiness of management personnel ability to manage digital library service A12 : The readiness of university's funding in organizing digital library A13 : The readiness of facilities and infrastructure that support digital library implementation A14 : Socialization for users about features that can be used in digital library A15 : Socialization about the required hardware in the digital library for the management team A16 : Socialization of the required software in the digital library for the management team A17 : Digital library operation for users A18 : Installation process and hardware settings required for digital library A19 : Installation process and software settings required for digital library A20 : Management for document data and file collection by digital library personnel A21 : Budget management by digital library personnel A22 : Quality of digital library service from tangibles dimension A23 : Quality of digital library service from reliability dimension A24 : Quality of digital library service from responsiveness dimension A25 : Quality of digital library service from assurance dimension A26 : Quality of digital library service from empathy dimension E1 : The 1 st education expert E2 : The 2 nd education expert E3 : The 1 st informatics expert E4 : The 2 nd informatics expert To obtain the ranking result on every evaluation components from the highest down to the lowest category, we use the weighted product method, with the following calculation phases.

Determining the Weight of Decision Makers
The weight of the decision maker is given for each evaluation aspects.To obtain weighted total value of 1, then the first process is weight improvement.The weight for each evaluation aspects and improvement can be seen in To obtain the results of weight improvement can be done by dividing the value of each weight of the decision maker with the total weight of decision makers.For example: the result of weight fixes for aspects with code A1 ie: 5/119 = 0.042, and so do the calculations using the same steps for other aspects in determining the weight improvement.

The Normalization Process
The normalization process is done to obtain the preference value for each evaluation components.The formula was used in this normalization process was as follows [33], [34].

The Ranking Process of Evaluation Components
To obtain the ranking of evaluation components from the highest down to the lowest category can be calculated using the following formula [33], [34].
Where : V : Relative preference value for ranking X : Criteria value w : Weight criteria Based on the formula, the following calculation can be done to obtain the ranking result from each evaluation components.
From the results of the vector-V value above, it can be determined the ranking of evaluation components that belongs to the highest category down to the lowest, which can be seen in the following Table 4.The CSE-UCLA model modified with the weighted product method is manifested through a desktop application program with glance views shown above.The complete features of this evaluation aplication based on CSE-UCLA modified with weighted product include: 1) login form, 2) main menu form, 3) user input data form, 4) interest rating input form, 5) form of weight making from decision maker, 6) form of questionnaire filling, 7) average aspect calculation form, 8) normalization calculation form, 9) ranking and recommendation form, and 10) evaluation result form.
The login form contains the username and password that serves as the opening access for users and admins.If the username and password are correct, then the user can access the sub menu "user input data", sub menu "questionnaire filling", sub menu "decision", and sub menu "exit".While the admin can access sub menu "interest rating input", sub menu "data input of weight from decision makers", sub menu "average value of each aspect", sub menu "normalization", sub menus "rank and recommendation", and sub menu "exit".
The main menu form serves as a pointer to other forms.In the main menu form the evaluation aplication based on CSE-UCLA modified with weighted product consists of 4 pointers on the menu bar: the "file" pointer, the "process" pointer, the "about" pointer, and the "help" pointer.On the "file" pointer there is "user" menu, "admin" menu, and "exit" menu.On the "process" pointer there is a menu of "aspect average calculation", "normalization" menu, menu "rank and recommendations".In particular, in the "user" menu there are several sub menus, including: sub menu "user data input", sub menu "questionnaire filling", and sub menu "decision".
On the "admin" menu there are several sub menus, among others: sub menu "interest rating input", and sub menu "data input of weight from decision makers".The sub menu "user data input" is used as a link to the user input data form.The sub-menu of "questionnaire filling" is used to enter the respondent's assessment data on each evaluation aspects.The "decision" sub menu used to view the results of evaluation decision.The "interest rating input" sub menu is used to include an interest rating score.The "data input of weight from decision makers" sub menu is used to input weighted data provided by the decision maker against each evaluation aspects.The "exit" sub menu is used to close the application.The "aspect average calculation" menu is used as a link to the average value calculation process form for each evaluation aspects.The "normalization" menu is used as a link to the normalization form.The "rank and recommendations" menu used to rank calculations incorporates the constraints found in each aspect and recommendation as a problems solving.The pointer "about" is used as a pointer to the creator's identity information form and the specification of this application.Pointer "help" used by the user as a pointer to the manual information form the use of this application.
Form of user data input comes with features that can store user identity.Interest rating input form is equipped with features that can store interest rating score data, such as: excellent = 5, good = 4, moderate= 3, less = 2, and poor or don't choose any answer = 1.Form of weight making from decision maker is equipped with features that can store weighted data provided by the decision maker against each evaluation aspects.The questionnaire filling form comes with features that can store the results of the respondent's assessment of each evaluation aspects.The form of aspect average calculation is equipped with features that can determine and store the calculation data of average score given by the respondent to each evaluation aspects.Normalization calculation form is equipped with features that can calculate and store data result of normalization process that yield of vector-S value.Rank and recommendation forms are equipped with features that can determine the ranking results, insert constraints and put recommendations.Form evaluation results are equipped with features that can display the evaluation results.
Based on the result of field test simulation which has been done by 4 respondents, obtained the evaluation result in sequence from the highest category down to the lowest in each evaluation components that is started from system assessment components, program certification components, program planning components, program improvement components, and program implementation components.From the ranking results, it can be seen that the evaluation component that gets the highest category was the component of the system assessment, so that all aspects of the components, need to be maintained it was effectiveness.In addition, the evaluation component that received the lowest category was the implementation program, so that all aspects of the component need to be re-analyzed and given recommendations for improvement.The aspect of most program implementation components that need to be recommended to be improved when viewed from the simulation results of field trials were the aspect with the A16 code because the average evaluation aspect were 12.50.Code A16 were the aspects of software socialization required in digital libraries for librarians, with items that need to be optimized, among others: 1) the availability of information that must be clearly provided by the manager/developer team to the library operational officer about the software needed in carrying out the digital library program through the provision of a library manual, and 2) the availability of information that must be clearly provided by the management team/developer to the library operational officer about the software needed to run the digital library program through the workshop.
The results of this research have been able to answer the obstacles found in research conducted by Divayana [17], where the obstacle is not yet able to show accurately the aspects of evaluation that have not been optimal implementation and also the application features that have not been able to add new aspects dynamically.However, through the implementation of this research, these constraints have been answered by obtaining a sequence ranging from the highest down to the lowest category on each evaluation components, so it can be seen that aspects are not yet optimal through the lowest categorized evaluation component.Besides that, in this research result of evaluation application which have been equipped with dynamic feature to be able to add new evaluation aspect.
The results of this research also have been able to answer the first year research obstacles that have been done by Divayana, Adiarta and Abadi [4] that is constraint in the case of the research results is still limited to the design of evaluation model and limitations of the evaluation model design trial.However, with the results of this study it is clear that it has been able to answer these constraints by implementing the model design produced in the first year of research into a CSE-UCLA model evaluation application modified with weighted product.In addition, field trials have also been conducted on the application.Besides the existence of several advantages that have been shown in this research, there are also obstacles that become the findings in this research that is still not stable and optimally the evaluation model of CSE-UCLA model modified with Weighted Product can run because only limited field trial on this research, so need to look for further solutions so that applications can be more stable and ready to be applied thoroughly to evaluate digital library at all college computer in Bali.

CONCLUSION
Modification of the CSE-UCLA model used in evaluating the optimization of digital library services at computer colleges in Bali is manifested through a CSE-UCLA model-based evaluation application that inserts a weighted product method in the ranking process, resulting in more accurate evaluation results by defining and valid aspects of evaluation that do need special and focus for the revision / improvement, so that the implementation of digital library can run more optimal.This CSE-UCLA model evaluation application that modified with weighted product method has provided some comprehensive features and is able to facilitate the needs of its users especially in terms of ease in obtaining accurate evaluation results.The solution to overcome the obstacles encountered in this study is to test a usage that involves more respondents on a wider scale to test the reliability of these evaluation applications, so that these applications can become more reliable and tested.

Figure 1 .
Figure 1.Display of main menu

Figure 3 .
Figure 3. Display of evaluation results form

Table 1 .
. Results of Field Test Questionnaire on Implementation of Evaluation Application Based on CSE-UCLA Model that Modified by Weighted Product Method  Modification of CSE-UCLA Model Using Weighted Product in Optimizing… (Dewa Gede Hendra Divayana) 437

Table 1 .
Results of Field Test Questionnaire on Implementation of Evaluation Application Based on CSE-UCLA Model that Modified by Weighted Product Method

Table 2 .
Weight of Each Evaluation Aspect of CSE-UCLA Model to Evaluate on Digital Library at Computer College in Bali

Table 3 .
Data for Normalization Process Modification of CSE-UCLA Model Using Weighted Product in Optimizing… (Dewa Gede HendraDivayana)

Table 4 .
The Ranking of Each Component