Review and Questions for Week 6
Professor Yuefeng Li
School of Computer Science, Queensland University of Technology (QUT)
Evaluation overview
Copyright By PowCoder代写 加微信 powcoder
Evaluation is the key to making progress in building better search systems or IR models. One of the primary distinctions made in the evaluation of search systems is between effectiveness and efficiency. Effectiveness measures the ability of the search system to find the right information, and efficiency measures how quickly this is done.
The retrieval and indexing techniques have many parameters that can be adjusted to optimize performance, both in terms of effectiveness and efficiency. Typically, the best values for these parameters are determined using training data and a cost function. Training data is a sample of the real data, and the cost function is the quantity based on the data that is being maximized (or minimized).
The optimization process would use the training data to learn parameter settings for the ranking algorithm that maximized the effectiveness measure.
One of the basic requirements for evaluation is that the results from different techniques can be compared. To do this comparison fairly and to ensure that experiments are repeatable, the experimental settings and data used must be fixed.
We usually need to find a suitable data collection to test proposed models or algorithms. For example, AP (Associated Press) newswire documents from 1988–1990, which was created as part of the TREC conference series sponsored by the National Institute of Standards and Technology (NIST).
The queries for the AP are based on TREC topics. The topics were created by government information analysts employed by NIST. Queries are the title fields from TREC topics 51–150. Topics and relevance judgments generated by government information analysts.
Example of a TREC topic
Number: 794
pet therapy<br />
<desc> Description:<br />
How are pets or animals used in therapy for humans and what are the benefits?<br />
<narr> Narrative:<br />
Relevant documents must include details of how pet! or animal!assisted therapy is or has been used. Relevant details include information about pet therapy programs, descriptions of the circumstances in which pet therapy is used, the benefits of this type of therapy, the degree of success of this therapy, and any laws or regulations governing it. </top><br />
Relevance Judgments<br />
The relevance judgments depend on the task that is being evaluated. For example, TREC analysts judged a document as relevant if it contained information that could be used to help write a report on the query topic (here we primarily focused on topical relevance).<br />
Relevance judgments are normally binary, meaning that a document is either relevant or non-relevant. For some tasks, multiple levels of relevance may be appropriate, e.g., three levels of relevance (relevant, non-relevant, and neutral or unknown).<br />
Data collection can be divided into three parts (training set, validation and/or test set). We will discuss the partitions of data collection for information filtering and text classification.<br />
Creating a new test collection can be a time-consuming task since relevance judgments require a considerable investment of manual effort.<br />
Question 1. Which of the following are False? and justify your answer.<br />
(1) For a very large data collection, pooling technique is used to select top-k results from the rankings obtained by different retrieval algorithms. The results are merged into a pool, duplicates are removed, and the documents are presented in some random order to the people doing the relevance judgments.<br />
(2) Pooling produces a large number of relevance judgments for each query. However, this list is incomplete, and for a new retrieval algorithm that had not contributed documents to the original pool, this could potentially be a problem.</p>
<p>(3) Many user actions (e.g., Query log data) can be considered implicit relevance judgments. The main drawback with this data is that it is not as precise as explicit relevance judgments.<br />
(4) A typical query log does not contain user identifier or user session identifier because of the privacy issue.<br />
Question 2. (Effectiveness Metrics)<br />
Assume Table 1 illustrates the relevant judgments for documents 110 to 124 about topic 101, where 1 means the corresponding document is relevant and 0 means non-relevant; and Table 2 shows IR model1’s output, where documents are sorted according to their weights.<br />
Table 1. Relevant Judgements Table 2. IR Model1’s Output (ranked by weight)<br />
Assume A is the relevant set of documents for topic 101, A’ is the non-relevant set. We also assume IR model1 selects top-6 as the relevant documents B (i.e., the set of retrieved documents), and B’ is the set of documents that are not retrieved.<br />
(1) List all sets’ elements and enclose them in braces.<br />
(2) Calculate recall and precision of IR model1.<br />
(3) Calculate false positive and false negative of IR model1. (4) Calculate IR model1’s F1 measure.<br />
TOPIC DocNo Rel<br />
101 110 1<br />
101 111 1<br />
101 112 0<br />
101 113 1<br />
101 114 1<br />
101 115 0<br />
101 116 1<br />
101 117 1<br />
101 118 0<br />
101 119 1<br />
101 120 0<br />
101 121 0<br />
101 122 0<br />
101 123 1<br />
101 124 0<br />
TOPIC DocNo Weight<br />
101 111<br />
101 112<br />
101 113<br />
101 110<br />
101 114<br />
101 119<br />
101 115<br />
101 122<br />
101 118<br />
101 116<br />
101 123<br />
101 121<br />
101 120<br />
101 117<br />
101 124<br />
The set of retrieved documents</p>
<p>Ranking Effectiveness<br />
Most of retrieval models produce ranked output. For a fair comparison of recall and precision measures, the set of retrieved documents should be defined in terms of ranking. One possibility way is to calculate recall and precision values at every rank position p.<br />
There are several techniques have been developed to summarize the effectiveness of a ranking. The first one is simply to calculate recall-precision values at a small number of predefined rank positions. For a given query, to compare two or more rankings, the precision at the predefined rank positions needs to be calculated. This effectiveness measure is known as precision at rank p. The most common versions are precision at 10 and precision at 20 or 25.<br />
Another method of summarizing the effectiveness of a ranking is to calculate precision at fixed or standard recall levels from 0.0 to 1.0 in increments of 0.1. Each ranking is then represented using 11 numbers. This idea can be extended to calculate averaging effectiveness across queries and generating recall-precision graphs (interpolation).<br />
This method has the advantage of summarizing the effectiveness of the ranking of all relevant documents, rather than just those in the top ranks.<br />
The third method, and the most popular, is to summarize the ranking by averaging the precision values from the rank positions where a relevant document was retrieved (i.e., when recall increases).<br />
Average precision has several advantages. It is a single number that is based on the ranking of all the relevant documents, but the value depends heavily on the highly ranked relevant documents. This means it is an appropriate measure for evaluating the task of finding as many relevant documents as possible while still reflecting the intuition that the top-ranked documents are the most important.<br />
Question 3. For the give relevance judgment (Table 1) and the ranked output of IR model1 (Table 2).<br />
(1) Calculate IR model1’s precision at rank 6 (position 6) and precision at rank 10 (position 10).<br />
(2) Calculate IR model1’s average precision.</p>
<p>The aim of an averaging technique is to summarize the effectiveness of a specific ranking algorithm across multiple queries (40-50 queries are commonly recommended for evaluating IR models) rather than a single query since different queries will often have different numbers of relevant documents.<br />
Given that the average precision provides a number for each ranking, the simplest way to summarize the effectiveness of rankings from multiple queries would be to average these numbers. This effectiveness measure, mean average precision (MAP), is used in most research papers and some system evaluations.<br />
Also, an average recall-precision graph is plotted by simply joining (by using MAP) the average precision points at the standard recall levels.<br />
Question 4. Fig. 1 shows the recall and precision at positions 1, 2, … , 10 from two different queries query 1 and query 2. The precision P at any standard recall level R is defined as<br />
where S is the set of observed (R, P) points.<br />
(1) Calculate MAP of the two queries.<br />
(2) For query 1, list the elements of S in curly braces.<br />
(3) Calculate query 1’s precision P at any standard recall level R.<br />
Fig 1. Recall and precision values for rankings from two different queries<br />
(4) Assume S is represented as a list of recall-precision pairs, e.g., S = [(0.2, 1.0), (0.2, 0.5), (0.4, 0.67), (0.4, 0.5), (0.4, 0.4), (0.6, 0.5), (0.6, 0.43), (0.6, 0.38), (0.8, 0.44), (1.0, 0.5)]. Define a list comprehension to calculate precisions at all standard recall levels.</p>
<p>程序代写 <a href="https://powcoder.com/tag/代考/">CS代考</a> 加微信: powcoder QQ: 1823890830 Email: powcoder@163.com</p>
</div><!-- .entry-content .clear -->
</div>
</article><!-- #post-## -->
<nav class="navigation post-navigation" aria-label="Post navigation">
<span class="screen-reader-text">Post navigation</span>
<div class="nav-links"><div class="nav-previous"><a title="程序代写 MCIT 593 – Introduction to Computer Systems Property of Penn Engineering 2" href="https://powcoder.com/2022/05/30/%e7%a8%8b%e5%ba%8f%e4%bb%a3%e5%86%99-mcit-593-introduction-to-computer-systems-property-of-penn-engineering-2/" rel="prev"><span class="ast-left-arrow">←</span> Previous Post</a></div><div class="nav-next"><a title="CS代考 MB 655 kB/s eta 0:00:011" href="https://powcoder.com/2022/05/30/cs%e4%bb%a3%e8%80%83-mb-655-kb-s-eta-000011/" rel="next">Next Post <span class="ast-right-arrow">→</span></a></div></div>
</nav><div class="ast-single-related-posts-container ast-container--fallback"><div class="ast-related-posts-title-section"> <h2 class="ast-related-posts-title"> Related Posts </h2> </div><div class="ast-related-posts-wrapper"> <article class="ast-related-post post-38 post type-post status-publish format-standard hentry category-uncategorized tag-matlab tag-simulation">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/matlab-simulation/" target="_self" rel="bookmark noopener noreferrer">matlab simulation</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/matlab/" rel="tag">matlab代写代考</a>, <a href="https://powcoder.com/tag/simulation/" rel="tag">simulation</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-39 post type-post status-publish format-standard hentry category-uncategorized tag-c">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/ab202-assignment-1-arkapong/" target="_self" rel="bookmark noopener noreferrer">AB202 Assignment 1: Arkapong</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/c/" rel="tag">c++代做</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-40 post type-post status-publish format-standard hentry category-uncategorized tag-c">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/msc-c-programming/" target="_self" rel="bookmark noopener noreferrer">MSc C++ Programming</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/c/" rel="tag">c++代做</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-41 post type-post status-publish format-standard hentry category-uncategorized tag-prolog">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/msc-assessed-prolog-lab-exercise-2/" target="_self" rel="bookmark noopener noreferrer">MSc Assessed Prolog Lab Exercise 2</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/prolog/" rel="tag">Prolog代写代考</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-49 post type-post status-publish format-standard hentry category-uncategorized tag-c tag-uml">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/spring-session2015assignment-1/" target="_self" rel="bookmark noopener noreferrer">Spring Session:2015:Assignment 1</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/c/" rel="tag">c++代做</a>, <a href="https://powcoder.com/tag/uml/" rel="tag">UML</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-51 post type-post status-publish format-standard hentry category-uncategorized tag-uml">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/assignment-2-inception-and-elaboration/" target="_self" rel="bookmark noopener noreferrer">Assignment 2: "Inception and Elaboration"</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/uml/" rel="tag">UML</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-55 post type-post status-publish format-standard hentry category-uncategorized tag-android tag-java">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/android-app/" target="_self" rel="bookmark noopener noreferrer">android app</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/android/" rel="tag">android</a>, <a href="https://powcoder.com/tag/java/" rel="tag">Java代写代考</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
<article class="ast-related-post post-57 post type-post status-publish format-standard hentry category-uncategorized tag-java tag-junit">
<div class="ast-related-posts-inner-section">
<div class="ast-related-post-content">
<div class="ast-related-post-featured-section ast-no-thumb"></div> <header class="entry-header related-entry-header">
<h3 class="ast-related-post-title entry-title">
<a href="https://powcoder.com/2016/06/21/comp220-software-development-tools/" target="_self" rel="bookmark noopener noreferrer">COMP220: Software Development Tools</a>
</h3>
<div class="entry-meta ast-related-cat-style--none ast-related-tag-style--none"><span class="ast-taxonomy-container cat-links default"><a href="https://powcoder.com/category/uncategorized/" rel="category tag">程序代写 CS代考</a></span> / <span class="ast-taxonomy-container tags-links default"><a href="https://powcoder.com/tag/java/" rel="tag">Java代写代考</a>, <a href="https://powcoder.com/tag/junit/" rel="tag">junit</a></span></div> </header>
<div class="entry-content clear">
</div>
</div>
</div>
</article>
</div> </div> </main><!-- #main -->
</div><!-- #primary -->
<div class="widget-area secondary" id="secondary" itemtype="https://schema.org/WPSideBar" itemscope="itemscope">
<div class="sidebar-main" >
<aside id="custom_html-2" class="widget_text widget widget_custom_html"><h2 class="widget-title">Contact</h2><div class="textwidget custom-html-widget"><ul>
<li><strong>QQ: 1823890830</strong></li>
<li><strong>微信号(WeChat): powcoder</strong></li>
<li><img data-recalc-dims="1" class="alignnone wp-image-366" src="https://i0.wp.com/powcoder.com/wp-content/uploads/2021/01/powcoder.jpg?resize=133%2C133&ssl=1" alt="myweixin" width="133" height="133"/></li>
<li><strong>Email: <a href="mailto:powcoder@163.com">powcoder@163.com</a></strong></li>
</ul>
<ul>
<li><strong>请加微信或QQ发要求</strong></li>
<li><strong>Contact me through WeChat</strong></li>
</ul>
</div></aside><aside id="categories-2" class="widget widget_categories"><h2 class="widget-title">Categories</h2><nav aria-label="Categories">
<ul>
<li class="cat-item cat-item-245"><a href="https://powcoder.com/category/machine-learning/">机器学习代写代考 machine learning</a>
</li>
<li class="cat-item cat-item-242"><a href="https://powcoder.com/category/database-db-sql/">数据库代写代考 DB Database SQL</a>
</li>
<li class="cat-item cat-item-244"><a href="https://powcoder.com/category/data-structure-algorithm/">数据结构算法代写代考 data structure algorithm</a>
</li>
<li class="cat-item cat-item-239"><a href="https://powcoder.com/category/%e4%ba%ba%e5%b7%a5%e6%99%ba%e8%83%bd-ai-artificial-intelligence/">人工智能 AI Artificial Intelligence</a>
</li>
<li class="cat-item cat-item-247"><a href="https://powcoder.com/category/compiler/">编译器原理 Compiler</a>
</li>
<li class="cat-item cat-item-254"><a href="https://powcoder.com/category/network-socket/">计算机网络 套接字编程 computer network socket programming</a>
</li>
<li class="cat-item cat-item-240"><a href="https://powcoder.com/category/hadoop-map-reduce-spark-hbase/">大数据 Hadoop Map Reduce Spark HBase</a>
</li>
<li class="cat-item cat-item-241"><a href="https://powcoder.com/category/%e6%93%8d%e4%bd%9c%e7%b3%bb%e7%bb%9fosoperating-system/">操作系统OS代写代考 (Operating System)</a>
</li>
<li class="cat-item cat-item-250"><a href="https://powcoder.com/category/computer-architecture/">计算机体系结构代写代考 Computer Architecture</a>
</li>
<li class="cat-item cat-item-251"><a href="https://powcoder.com/category/computer-graphics-opengl-webgl/">计算机图形学 Computer Graphics opengl webgl</a>
</li>
<li class="cat-item cat-item-249"><a href="https://powcoder.com/category/nlp/">自然语言处理 NLP natural language processing</a>
</li>
<li class="cat-item cat-item-383"><a href="https://powcoder.com/category/%e5%b9%b6%e8%a1%8c%e8%ae%a1%e7%ae%97/">并行计算</a>
</li>
<li class="cat-item cat-item-253"><a href="https://powcoder.com/category/computation-theory/">计算理论 Theory of Computation</a>
</li>
<li class="cat-item cat-item-252"><a href="https://powcoder.com/category/computer-security/">计算机安全密码学computer security cryptography</a>
</li>
<li class="cat-item cat-item-246"><a href="https://powcoder.com/category/sys-programming/">系统编程 System programming</a>
</li>
<li class="cat-item cat-item-367"><a href="https://powcoder.com/category/%e6%95%b0%e5%80%bc%e7%a7%91%e5%ad%a6%e8%ae%a1%e7%ae%97/">数值科学计算</a>
</li>
<li class="cat-item cat-item-255"><a href="https://powcoder.com/category/%e8%ae%a1%e7%ae%97%e6%9c%ba%e8%a7%86%e8%a7%89compute-vision/">计算机视觉代写代考(Compute Vision)</a>
</li>
<li class="cat-item cat-item-248"><a href="https://powcoder.com/category/web/">网页应用 Web Application</a>
</li>
<li class="cat-item cat-item-401"><a href="https://powcoder.com/category/%e5%88%86%e5%b8%83%e5%bc%8f%e7%b3%bb%e7%bb%9f/">分布式系统</a>
</li>
<li class="cat-item cat-item-640"><a href="https://powcoder.com/category/%e7%ac%94%e8%af%95%e9%9d%a2%e8%af%95/">笔试面试</a>
</li>
<li class="cat-item cat-item-403"><a href="https://powcoder.com/category/%e5%87%bd%e6%95%b0%e5%bc%8f%e7%bc%96%e7%a8%8b/">函数式编程</a>
</li>
<li class="cat-item cat-item-243"><a href="https://powcoder.com/category/%e6%95%b0%e6%8d%ae%e6%8c%96%e6%8e%98-data-mining/">数据挖掘 Data Mining</a>
</li>
<li class="cat-item cat-item-364"><a href="https://powcoder.com/category/%e7%a6%bb%e6%95%a3%e6%95%b0%e5%ad%a6/">离散数学代写代考 (Discrete mathematics)</a>
</li>
<li class="cat-item cat-item-384"><a href="https://powcoder.com/category/%e8%bd%af%e4%bb%b6%e5%b7%a5%e7%a8%8b/">软件工程</a>
</li>
<li class="cat-item cat-item-551"><a href="https://powcoder.com/category/%e7%bc%96%e7%a8%8b%e8%af%ad%e8%a8%80-programming-language/">编程语言 Programming Language</a>
</li>
<li class="cat-item cat-item-594"><a href="https://powcoder.com/category/%e7%bb%9f%e8%ae%a1%e4%bb%a3%e5%86%99%e4%bb%a3%e8%80%83/">统计代写代考</a>
</li>
<li class="cat-item cat-item-574"><a href="https://powcoder.com/category/%e8%bf%90%e7%ad%b9%e5%ad%a6-operation-research/">运筹学 Operation Research</a>
</li>
</ul>
</nav></aside><aside id="tag_cloud-3" class="widget widget_tag_cloud"><h2 class="widget-title">Tag</h2><nav aria-label="Tag"><div class="tagcloud"><a href="https://powcoder.com/tag/algorithm/" class="tag-cloud-link tag-link-469 tag-link-position-1" style="font-size: 18px;" aria-label="Algorithm算法代写代考 (15,143 items)">Algorithm算法代写代考</a><a href="https://powcoder.com/tag/java/" class="tag-cloud-link tag-link-298 tag-link-position-2" style="font-size: 16.91156462585px;" aria-label="Java代写代考 (7,271 items)">Java代写代考</a><a href="https://powcoder.com/tag/database/" class="tag-cloud-link tag-link-414 tag-link-position-3" style="font-size: 16.503401360544px;" aria-label="database (5,442 items)">database</a><a href="https://powcoder.com/tag/data-structure/" class="tag-cloud-link tag-link-501 tag-link-position-4" style="font-size: 16.401360544218px;" aria-label="data structure (5,185 items)">data structure</a><a href="https://powcoder.com/tag/python/" class="tag-cloud-link tag-link-331 tag-link-position-5" style="font-size: 16.299319727891px;" aria-label="Python代写代考 (4,810 items)">Python代写代考</a><a href="https://powcoder.com/tag/compiler/" class="tag-cloud-link tag-link-472 tag-link-position-6" style="font-size: 16.027210884354px;" aria-label="compiler (4,000 items)">compiler</a><a href="https://powcoder.com/tag/scheme/" class="tag-cloud-link tag-link-338 tag-link-position-7" style="font-size: 15.823129251701px;" aria-label="Scheme代写代考 (3,502 items)">Scheme代写代考</a><a href="https://powcoder.com/tag/c-4/" class="tag-cloud-link tag-link-499 tag-link-position-8" style="font-size: 15.823129251701px;" aria-label="C语言代写 (3,489 items)">C语言代写</a><a href="https://powcoder.com/tag/ai/" class="tag-cloud-link tag-link-369 tag-link-position-9" style="font-size: 15.176870748299px;" aria-label="AI代写 (2,216 items)">AI代写</a><a href="https://powcoder.com/tag/c-3/" class="tag-cloud-link tag-link-491 tag-link-position-10" style="font-size: 14.700680272109px;" aria-label="c++代写 (1,633 items)">c++代写</a><a href="https://powcoder.com/tag/sql/" class="tag-cloud-link tag-link-395 tag-link-position-11" style="font-size: 14.530612244898px;" aria-label="SQL代写代考 (1,457 items)">SQL代写代考</a><a href="https://powcoder.com/tag/haskell/" class="tag-cloud-link tag-link-291 tag-link-position-12" style="font-size: 14.530612244898px;" aria-label="Haskell代写代考 (1,453 items)">Haskell代写代考</a><a href="https://powcoder.com/tag/javascript/" class="tag-cloud-link tag-link-299 tag-link-position-13" style="font-size: 14.462585034014px;" aria-label="javascript (1,395 items)">javascript</a><a href="https://powcoder.com/tag/concurrency/" class="tag-cloud-link tag-link-503 tag-link-position-14" style="font-size: 14.428571428571px;" aria-label="concurrency (1,355 items)">concurrency</a><a href="https://powcoder.com/tag/matlab/" class="tag-cloud-link tag-link-309 tag-link-position-15" style="font-size: 14.360544217687px;" aria-label="matlab代写代考 (1,281 items)">matlab代写代考</a><a href="https://powcoder.com/tag/finance/" class="tag-cloud-link tag-link-282 tag-link-position-16" style="font-size: 14.292517006803px;" aria-label="finance (1,221 items)">finance</a><a href="https://powcoder.com/tag/interpreter/" class="tag-cloud-link tag-link-297 tag-link-position-17" style="font-size: 14.190476190476px;" aria-label="interpreter (1,144 items)">interpreter</a><a href="https://powcoder.com/tag/mips/" class="tag-cloud-link tag-link-313 tag-link-position-18" style="font-size: 14.156462585034px;" aria-label="MIPS汇编代写代考 (1,134 items)">MIPS汇编代写代考</a><a href="https://powcoder.com/tag/data-mining/" class="tag-cloud-link tag-link-271 tag-link-position-19" style="font-size: 13.986394557823px;" aria-label="data mining (991 items)">data mining</a><a href="https://powcoder.com/tag/decision-tree/" class="tag-cloud-link tag-link-273 tag-link-position-20" style="font-size: 13.952380952381px;" aria-label="decision tree (982 items)">decision tree</a><a href="https://powcoder.com/tag/deep-learning/" class="tag-cloud-link tag-link-274 tag-link-position-21" style="font-size: 13.952380952381px;" aria-label="deep learning深度学习代写代考 (980 items)">deep learning深度学习代写代考</a><a href="https://powcoder.com/tag/prolog/" class="tag-cloud-link tag-link-329 tag-link-position-22" style="font-size: 13.918367346939px;" aria-label="Prolog代写代考 (957 items)">Prolog代写代考</a><a href="https://powcoder.com/tag/file-system/" class="tag-cloud-link tag-link-281 tag-link-position-23" style="font-size: 13.850340136054px;" aria-label="file system (902 items)">file system</a><a href="https://powcoder.com/tag/c/" class="tag-cloud-link tag-link-265 tag-link-position-24" style="font-size: 13.578231292517px;" aria-label="c++代做 (764 items)">c++代做</a><a href="https://powcoder.com/tag/computer-architecture/" class="tag-cloud-link tag-link-507 tag-link-position-25" style="font-size: 13.47619047619px;" aria-label="computer architecture (712 items)">computer architecture</a><a href="https://powcoder.com/tag/er/" class="tag-cloud-link tag-link-433 tag-link-position-26" style="font-size: 13.47619047619px;" aria-label="ER (711 items)">ER</a><a href="https://powcoder.com/tag/gui/" class="tag-cloud-link tag-link-290 tag-link-position-27" style="font-size: 13.47619047619px;" aria-label="gui (711 items)">gui</a><a href="https://powcoder.com/tag/gpu/" class="tag-cloud-link tag-link-396 tag-link-position-28" style="font-size: 13.272108843537px;" aria-label="GPU (620 items)">GPU</a><a href="https://powcoder.com/tag/data-science/" class="tag-cloud-link tag-link-272 tag-link-position-29" style="font-size: 13.272108843537px;" aria-label="data science (615 items)">data science</a><a href="https://powcoder.com/tag/x86%e6%b1%87%e7%bc%96/" class="tag-cloud-link tag-link-514 tag-link-position-30" style="font-size: 13.238095238095px;" aria-label="x86汇编代写代考 (606 items)">x86汇编代写代考</a><a href="https://powcoder.com/tag/case-study/" class="tag-cloud-link tag-link-468 tag-link-position-31" style="font-size: 13.204081632653px;" aria-label="case study (586 items)">case study</a><a href="https://powcoder.com/tag/distributed-system/" class="tag-cloud-link tag-link-277 tag-link-position-32" style="font-size: 13.170068027211px;" aria-label="distributed system (576 items)">distributed system</a><a href="https://powcoder.com/tag/android/" class="tag-cloud-link tag-link-256 tag-link-position-33" style="font-size: 13.034013605442px;" aria-label="android (527 items)">android</a><a href="https://powcoder.com/tag/kernel/" class="tag-cloud-link tag-link-470 tag-link-position-34" style="font-size: 13.034013605442px;" aria-label="kernel (520 items)">kernel</a><a href="https://powcoder.com/tag/arm/" class="tag-cloud-link tag-link-483 tag-link-position-35" style="font-size: 13px;" aria-label="ARM汇编代写代考 (514 items)">ARM汇编代写代考</a></div>
</nav></aside><aside id="block-4" class="widget widget_block">
<div class="wp-block-group is-layout-flow wp-block-group-is-layout-flow"><div class="wp-block-group__inner-container"><ul class="wp-block-latest-posts__list wp-block-latest-posts"><li><a class="wp-block-latest-posts__post-title" href="https://powcoder.com/2024/11/17/%e7%95%99%e5%ad%a6%e7%94%9f%e4%bd%9c%e4%b8%9a%e4%bb%a3%e5%86%99-comp9313-project-3/">留学生作业代写 COMP9313 Project 3</a></li>
<li><a class="wp-block-latest-posts__post-title" href="https://powcoder.com/2024/10/12/%e7%a8%8b%e5%ba%8f%e4%bb%a3%e5%86%99-comp2521-24t3-assignment-1-2/">程序代写 COMP2521 24T3 – Assignment 1</a></li>
<li><a class="wp-block-latest-posts__post-title" href="https://powcoder.com/2024/10/12/%e4%bb%a3%e5%86%99%e4%bb%a3%e8%80%83-compsys-705-formal-methods-for-safety-critical-software-test-17-october-20/">代写代考 COMPSYS 705 Formal Methods for Safety Critical Software Test, 17 October 20</a></li>
<li><a class="wp-block-latest-posts__post-title" href="https://powcoder.com/2024/10/07/%e7%a8%8b%e5%ba%8f%e4%bb%a3%e5%86%99-comp2521-24t3-assignment-1/">程序代写 COMP2521 24T3 – Assignment 1</a></li>
<li><a class="wp-block-latest-posts__post-title" href="https://powcoder.com/2024/09/30/%e7%a8%8b%e5%ba%8f%e4%bb%a3%e5%86%99-comp4500-7500-2/">程序代写 COMP4500/7500</a></li>
</ul></div></div>
</aside>
</div><!-- .sidebar-main -->
</div><!-- #secondary -->
</div> <!-- ast-container -->
</div><!-- #content -->
<footer
class="site-footer" id="colophon" itemtype="https://schema.org/WPFooter" itemscope="itemscope" itemid="#colophon">
<div class="site-below-footer-wrap ast-builder-grid-row-container site-footer-focus-item ast-builder-grid-row-full ast-builder-grid-row-tablet-full ast-builder-grid-row-mobile-full ast-footer-row-stack ast-footer-row-tablet-stack ast-footer-row-mobile-stack" data-section="section-below-footer-builder">
<div class="ast-builder-grid-row-container-inner">
<div class="ast-builder-footer-grid-columns site-below-footer-inner-wrap ast-builder-grid-row">
<div class="site-footer-below-section-1 site-footer-section site-footer-section-1">
<div class="ast-builder-layout-element ast-flex site-footer-focus-item ast-footer-copyright" data-section="section-footer-builder">
<div class="ast-footer-copyright"><p>Copyright © 2024 PowCoder代写 | Powered by <a href="https://wpastra.com/" rel="nofollow noopener" target="_blank">Astra WordPress Theme</a></p>
</div> </div>
</div>
</div>
</div>
</div>
</footer><!-- #colophon -->
</div><!-- #page -->
<link rel="stylesheet" href="https://powcoder.com/wp-content/cache/minify/12163.css" media="all" />
<script id="astra-theme-js-js-extra">
var astra = {"break_point":"921","isRtl":"","is_scroll_to_id":"","is_scroll_to_top":"","is_header_footer_builder_active":"1","responsive_cart_click":"flyout"};
</script>
<script src="https://powcoder.com/wp-content/cache/minify/75800.js"></script>
<script src="https://stats.wp.com/e-202447.js" id="jetpack-stats-js" data-wp-strategy="defer"></script>
<script id="jetpack-stats-js-after">
_stq = window._stq || [];
_stq.push([ "view", JSON.parse("{\"v\":\"ext\",\"blog\":\"132118579\",\"post\":\"73242\",\"tz\":\"8\",\"srv\":\"powcoder.com\",\"j\":\"1:14.0\"}") ]);
_stq.push([ "clickTrackerInit", "132118579", "73242" ]);
</script>
<script>
/(trident|msie)/i.test(navigator.userAgent)&&document.getElementById&&window.addEventListener&&window.addEventListener("hashchange",function(){var t,e=location.hash.substring(1);/^[A-z0-9_-]+$/.test(e)&&(t=document.getElementById(e))&&(/^(?:a|select|input|button|textarea)$/i.test(t.tagName)||(t.tabIndex=-1),t.focus())},!1);
</script>
</body>
</html>
<!--
Performance optimized by W3 Total Cache. Learn more: https://www.boldgrid.com/w3-total-cache/
Object Caching 275/336 objects using Disk
Page Caching using Disk: Enhanced
Content Delivery Network via N/A
Minified using Disk
Served from: powcoder.com @ 2024-11-23 03:23:03 by W3 Total Cache
-->