i&dZddlZddlZddlZddlmZddlmZmZm Z ddl m Z ddl m Z ddlmZej eZ d6dededededededededefdZedk(rddlZej0dZej5deddej5ded dej5d edd!ej5d"ed#d$gd%&ej5d'ed#dd(&ej5d)ed d*ej5d+ed d,ej5d-ed d.ej5d/ed gd0d12ej7Zej:ej<d34eej>ej@ejBeejDejFreejFndejHejJejLejN5 Z(yy)7zAExperiment runner for comparing baseline and contrastive methods.N)Path)DictListAny)PipelineManager) UserSimulator)InteractionEvaluatorconfig/config_baseline.yamlconfig/config_contrastive.yaml resultsmixedbaseline_configcontrastive_configpreference_weighted_configliked_featuresdisliked_featurestop_krounds output_dirsampling_strategyc |dh}|du} tjdtjd| rdndztjdtj|dt || } tjd  t |} tjd tjd t |} tjdtjdtjdtjdt| | |||}|j}tjdtjdtjdt| | |||}|j}d}| rtjdtjdtjd t |}t|| |||}|j}tjj|d}t|d5}tj||ddddttjj|dd5}tj|d|ddddtjd|tjj|d}tjj|d}t|d5}tj||ddddt|d5}tj||ddddtjj|d }tjj|d!}t|d5}tj|d|ddddt|d5}tj|d|ddddtjd"tjd#|tjd$|tjd%|tjd&|tjdtjd'tjdtjd(tjd)|dd*d+tjd,|d-d*d+tjd.|d/d*d+tjd0|d1d*d+tjd2tjd)|dd*d+tjd,|d-d*d+tjd.|d/d*d+tjd0|d1d*d+|rtjd3tjd)|dd*d+tjd,|d-d*d+tjd.|d/d*d+tjd0|d1d*d+tjd4tjd)|dd*|dd*z d+tjd,|d-d*|d-d*z d+tjd.|d/d*|d/d*z d+tjd0|d1d*|d1d*z d+||d5}|||d6<|S#t $r } tjd | d d} ~ wwxYw#t $r } tjd| d d} ~ wwxYw#1swY.xYw#1swYxYw#t $r%} tjd| d Yd} ~ d} ~ wwxYw#1swYxYw#1swYxYw#1swY#xYw#1swYxYw)7aRun experiment comparing baseline, contrastive, and optionally preference-weighted methods. Args: baseline_config: Path to baseline configuration file contrastive_config: Path to contrastive configuration file preference_weighted_config: Optional path to preference-weighted config (2025-style); if None, only run baseline vs contrastive liked_features: Set of features user likes (default: {"Restaurant"}) disliked_features: Set of features user dislikes (default: None) top_k: Number of top patterns to recommend each round rounds: Number of interaction rounds output_dir: Directory to save results Returns: Dictionary with baseline, contrastive, and optionally preference_weighted results N Restaurantz<============================================================z,Starting Experiment: Baseline vs Contrastivez vs Preference-WeightedT)exist_ok)rrz Initializing baseline manager...z)Baseline manager initialized successfullyz'Failed to initialize baseline manager: )exc_infoz#Initializing contrastive manager...z,Contrastive manager initialized successfullyz*Failed to initialize contrastive manager: z= ============================================================zRunning Baseline Evaluation)rrrzRunning Contrastive EvaluationzCRunning Preference-Weighted Evaluation (2025-style adaptive fusion)z metrics_preference_weighted.jsonw)indentz!accuracy_preference_weighted.jsonaccuracyz% Preference-Weighted (all metrics): z Preference-Weighted run failed: zmetrics_baseline.jsonzmetrics_contrastive.jsonzaccuracy_baseline.jsonzaccuracy_contrastive.jsonz Results saved:z Baseline (all metrics): z Contrastive (all metrics): z Baseline (accuracy only): z Contrastive (accuracy only): zExperiment SummaryzBaseline - Final Metrics:z Accuracy: z.4fz Precision: precisionz Recall: recallz F1: f1z Contrastive - Final Metrics:z% Preference-Weighted - Final Metrics:z' Improvement (Contrastive vs Baseline):)baseline contrastivepreference_weighted)loggerinfoosmakedirsrr Exceptionerrorr runpathjoinopenjsondump)rrrrrrrrr run_third simulatorbaseline_managerecontrastive_manager baseline_evalbaseline_resultscontrastive_evalcontrastive_resultspreference_weighted_results pw_managerpw_evalpw_pathf baseline_pathcontrastive_pathbaseline_acc_pathcontrastive_acc_pathouts H/home/ubuntu/codebase/yexijia/保研/colocation_mvp/experiment/runner.pyrun_experimentrIsI4&*$6I KK KK>_hB[npqr KKKK T*%+I  KK23*?; ?@  KK56-.@A BC  KK  KK-. KK(+ M%((* KK  KK01 KK++ +..0"& O$ YZ H P()CDJ*"3 G+2++- 'ggll:/QRGgs#q 5qC$bggll:/RSUXY]^ 5jA1QOZ KK?yI J GGLL-DEMww||J0JK mS !Q "Aa0 "  $ %q3 % Z1IJ77<< 4OP  % ":.!< & "C (A %j11Q? ) KK"$ KK,]O<= KK/0@/ABC KK./@.ABC KK12F1GHI KK  KK$% KK KK+, KK- 0 sCDE KK- 0 6r :3?@A KK01 KK- 3J ? CCHIJ KK- 3K @ DSIJK KK- 3H =b A#FGH KK- 3D 9" =cBCD" <= m$? $KB$OPS#TUV m$? $LR$PQT#UVW m$?$I"$Mc#RST m$?$Eb$I##NOP KK:; KK- 3J ? CFVWaFbceFf fgjklm KK- 3K @ DGWXcGdegGh hilmno KK- 3H =b ADTU]D^_aDb bcfghi KK- 3D 9" =@PQU@VWY@Z Z[^_`a'8K LC".%@ !" Ji  >qcBT R   A!EPT U \$#YY P LL;A3?$L O O P " ! % $ & % ) (s \' ]#A^:]?2^^ ! ^ _ :_'_$_1' ]0]  ] ]<]77]<?^ ^ ^^ _"__ __!$_.1_;__main__z"Run preference learning experiment) descriptionz--baseline-configz#Path to baseline configuration file)typedefaulthelpz--contrastive-configz&Path to contrastive configuration filez--preference-weighted-configzMPath to preference-weighted config (2025-style); if set, run 3-way comparisonz--liked-features+rzFeatures user likes)rLnargsrMrNz--disliked-featureszFeatures user dislikesz--top-kz#Number of top patterns to recommendz--roundszNumber of interaction roundsz --output-dirzOutput directory for resultsz--sampling-strategy)topr stratified uncertaintyzWPattern sampling strategy: top (original), mixed (recommended), stratified, uncertainty)rLrMchoicesrNz4%(asctime)s - %(name)s - %(levelname)s - %(message)s)levelformat) rrrrrrrrr) r r NNNr r rr))__doc__loggingr3r+pathlibrtypingrrrcontroller.managerrexperiment.simulatorrexperiment.evaluatorr getLogger__name__r)strsetintrIargparseArgumentParserparser add_argument parse_argsargs basicConfigINFOrrrrrrrrrrrHrmsG ""..5   8 $9>&*!$ddd!$d d  d  d dddN z $X $ $1U VF +#?\AC .SBbDF 6S$km *C,13 -CsD46  QAC  b:< S):< -CLuw    DGllE ,,22#'#B#B4../9=9O9O#d445UYjj{{??00 GCrl