Table 1 Test users profiles and platform... | Emerald Publishing

Table 1

Test users profiles and platform evaluation methods overview

Phases		Phase A	Phase B
Users’ profiles	Users	10 young entrepreneurs, members of an incubation centre	20 domain experts, executives of a grocery supplier (actual end-users of the platform)
	Mean Age	34	41
	Gender	6 males, 4 females	12 males, 8 females
	Role	3 business analysts 2 marketing managers 2 salespersons 1 project manager 1 software engineer 1 business development manager	4 advertising managers 3 marketing managers 3 business analysts 2 digital marketing managers 2 account managers 2 sales managers 1 business and strategy manager 1 merchandiser 1 e-commerce manager 1 consumer research manager
	Industry Expertise	Retail, e-commerce, gaming, advertising, banking, insurance	Grocery retail

Phases		Phase A	Phase B
Users’ profiles	Users	10 young entrepreneurs, members of an incubation centre	20 domain experts, executives of a grocery supplier (actual end-users of the platform)
	Mean Age	34	41
	Gender	6 males, 4 females	12 males, 8 females
	Role	3 business analysts 2 marketing managers 2 salespersons 1 project manager 1 software engineer 1 business development manager	4 advertising managers 3 marketing managers 3 business analysts 2 digital marketing managers 2 account managers 2 sales managers 1 business and strategy manager 1 merchandiser 1 e-commerce manager 1 consumer research manager
	Industry Expertise	Retail, e-commerce, gaming, advertising, banking, insurance	Grocery retail

Versions		Version A	Version B		Version C
	UI	Heuristic evaluation survey based on Nielsen’s principles	Heuristic evaluation survey based on Nielsen’s principles		Heuristic evaluation survey based on Nielsen’s principles
		Runtime per task (as measured by researchers)	Runtime per task (as measured by researchers)	Runtime per task (as measured by users)^a	Runtime per task (as measured by users)³
Evaluation methods		Number of errors (as measured by researchers)	Number of errors (as measured by researchers)	Perception about errors (as declared by users)^a	Perception about errors (as declared by users)³
		Observations Semi-structured interviews Think-aloud techniques	Observations Semi-structured interviews Think-aloud techniques	Notes taking (from users)^a Semi-structured interviews	Notes taking (from users)³ Semi-structured interviews
	UX	Users’ emotions (software based)	Users’ emotions (software based)	Users’ emotions (as declared by users)^a	Users’ emotions (as declared by users)^a
	UX	Semi-structured interviews Think-aloud techniques	Semi-structured interviews Think-aloud techniques	Semi-structured interviews Notes taking (from users)³	Semi-structured interviews Notes taking (from users)³
	Insights Understanding	Semi-structured interviews	Semi-structured interviews	Semi-structured interviews	Semi-structured interviews

Versions		Version A	Version B		Version C
	UI	Heuristic evaluation survey based on Nielsen’s principles	Heuristic evaluation survey based on Nielsen’s principles		Heuristic evaluation survey based on Nielsen’s principles
		Runtime per task (as measured by researchers)	Runtime per task (as measured by researchers)	Runtime per task (as measured by users)^a	Runtime per task (as measured by users)³
Evaluation methods		Number of errors (as measured by researchers)	Number of errors (as measured by researchers)	Perception about errors (as declared by users)^a	Perception about errors (as declared by users)³
		Observations Semi-structured interviewsThink-aloud techniques	Observations Semi-structured interviewsThink-aloud techniques	Notes taking (from users)^aSemi-structured interviews	Notes taking (from users)³Semi-structured interviews
	UX	Users’ emotions (software based)	Users’ emotions (software based)	Users’ emotions (as declared by users)^a	Users’ emotions (as declared by users)^a
	UX	Semi-structured interviewsThink-aloud techniques	Semi-structured interviewsThink-aloud techniques	Semi-structured interviewsNotes taking (from users)³	Semi-structured interviewsNotes taking (from users)³
	Insights Understanding	Semi-structured interviews	Semi-structured interviews	Semi-structured interviews	Semi-structured interviews

Note(s): ^aIn Phase B, due to COVID-19 restrictions, there were changes in data collection compared to Phase A

Source(s): Table created by authors