Feature: Add warning and collect details of URL errors in sitemap (#830)

* adding server error check

* Throw error properly without printing the whole stack trace.

* Add failure cross when analysis fails.
Continue analysing in sitemap if single url is invalid.

* Add support to collect all erroredOutUrls.

* Move getSiteReport to utils package.

* Add Urls with issues to cli dashboard.

* Add support for stackTrace in error collection.

* Add URL with issue icon.

* Add error stack trace properly.

* Fix failing tests

* Fix cli e2e

* Fix cli e2e and update the icon size.

* Test cli e2e test passing.

* Remove rmsync.

* Change the url for testing.

* Remove debug.

* Skip CLI E2E tests.

* Change description to error description.

* Add a console.log message to indicate failing urls.

* Add method to generate error logs.

* Prettify stack trace.
Add error.log in the stack trace.

* Add feedback for the urls.

* Fix bugs.

* Fix name or urls.

* Fix condition.

* Fix QA feedbacks.

* Fix url in sidebar.

* use url instead of _url

* Use shorthand and use index.

* Refactor code.

* Move error logs in common and download errorlog when using -o.

* Address minor code feedbacks.

---------

Co-authored-by: Fellyph Cintra <[email protected]>

packages/common/src/utils/extractReportData.ts

@@ -48,15 +48,6 @@ const extractReportData = (data: CompleteJson[]) => {
     consolidatedLibraryMatches[pageUrl] = libraryMatches;
   });
 
-  data.forEach(({ cookieData, pageUrl, libraryMatches }) => {
-    formatCookieData(
-      extractCookies(cookieData, pageUrl, true),
-      landingPageCookies
-    );
-
-    consolidatedLibraryMatches[pageUrl] = libraryMatches;
-  });
-
   return {
     landingPageCookies,
     consolidatedLibraryMatches,