New Scraper: Woodlake City Council

Create a new scraper for Woodlake City Council
Jurisdiction: Woodlake
Website: https://cityofwoodlake.com/government/

aloha. @jpt-c
OK, in the scrapy shell when fetching the url, im getting the below error.
(i know the url looks weird. the website uses an iframe of agenda pdfs stored in a google drive folder, and the url is the iframe url)
    >>> fetch('https://drive.google.com/embeddedfolderview?id=1BlNtMxhYJTbrjeqGQUkZhj_8RtqrX1eI#list')
    2022-09-28 23:24:57 [scrapy.downloadermiddlewares.robotstxt] DEBUG: Forbidden by robots.txt: <GET https://drive.google.com/embeddedfolderview?id=1BlNtMxhYJTbrjeqGQUkZhj_8RtqrX1eI#list>
    >>>

Hey, just replied on Slack too :)
Don't try to scrape Google Drive, easy way to get blocked by Google altogether which is no fun.
If that's the source for their agenda we'll need people to handle this in a different way.  Let's leave this one be.

using google drive to store their agendas instead of displaying the agendas directly on their website. can’t scrape google drive (they block very fast, and it could affect your home use of google).


Best way to convert docx into pdf

It's not an issue (or a bug) but an open question. I would like to convert docx files (or word xml document) into PDF in the browser. As of today, there is no solution...so I thought I could start working on that.
My question is: how would you do it? I was wondering if I could use emscripten in some way to avoid going through word and pdf standard documents (which is not an option, it would take forever). Another approach would be to convert the docx into a more readable format (flat xml) and parse it to create a JSON PDFKit supports.
I was also wondering if it's possible to use the modern browsers ability to do it. What I mean is that browsers in all platforms (tablet, phone, computer) can print a Word document with a true representation (WYSIWYG) so why can't we use this ability to transform the Word document?
What about WEBKIT.JS? Could it help in any way?

It's just a matter of parsing the file.   Try googling something like "docx parser javascript" to see what's already out there.  First result is docx.js which seems to convert to html, which could then be glued together with pdfkit to get a pretty good pdf approximation of the original. Depending on your use-case, it may simpler to just  "print to pdf" from your browser. As far as I know, none of the browsers currently have APIs for using the built in parsers.

Well, it's in fact much more difficult that what you think. DocX (or openXML) is a very complex standard so even if you parse it, you still need to convert it! Docx.js seems abandoned and the html conversion is in alpha version...


Added delay for connect abort

freerdp_connect resets the abort event. This opens a race window for TestConnect. Fix it by waiting until at least freerdp_connect is called.

@hardening Yay, another race :/


Always respect explicit row() calls (fixes #4183)

If the user calls row() it can be assumed the user definitely wants a new row. #4183 describes a case where this is needed.

Accidentally deleted wrong branch. Will submit again.


add support for gRpc

Does moloch plan to support gRpc protocol?
I'd like to know gRpc protocol support plan.
And If you have the plan, Please add logic to parse and index about gRpc protocol.

/So besides Content-Type of application/grpc what else should Arkime do?


[FLINK-27773][sql-gateway]Introduce the rest E2E tests for SQL Gateway

What is the purpose of the change
Introduce the rest E2E tests for SQL Gateway
Brief change log

Add the rest part of E2E test for Sql Gateway

Verifying this change
This change added tests and can be verified as follows:

None

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes)
The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (no)
The S3 file system connector: (no)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not documented)

@flinkbot run azure

@flinkbot run azure


[INF] Update code_check github actions black version

PR Description
Please describe the changes proposed in the pull request:

pre-commit hooks black version has been updated. github actions black version wasn't updated. Both versions are formatting rules are a bit differently causing conflicts.
Updated the black version in the code_checks yaml file to match the pre-commit hooks black version.
Updated the black version in the environment-dev yaml file.

**This PR resolves #846 **

PR Checklist

Please ensure that you have done the following:

[x] PR in from a fork off your branch. Do not PR from <your_username>:dev, but rather from <your_username>:<feature-branch_name>.

[x] If you're not on the contributors list, add yourself to AUTHORS.rst.

[x] Add a line to CHANGELOG.md under the latest version header (i.e. the one that is "on deck") describing the contribution.

Do use some discretion here; if there are multiple PRs that are related, keep them in a single line.

Automatic checks
There will be automatic checks run on the PR. These include:

Building a preview of the docs on Netlify
Automatically linting the code
Making sure the code is documented
Making sure that all tests are passed
Making sure that code coverage doesn't go down.

Relevant Reviewers

Please tag maintainers to review.

@ericmjl
@loganthomas
@samukweku

@ericmjl @loganthomas After updating the black version, black is showing more files to be updated compared to old version of black. Shall I proceed to format the files with new version of black  and update the PR ?

@nvamsikrishna05 yes, I believe that would be an awesome course of action here! Thank you for handling this!

@ericmjl PR has been updated with the newer version of black formatted code also. You can review the changes and merge it.

@nvamsikrishna05 can you ping me via Shortwhale (http://www.shortwhale.com/ericmjl)? I'd like to invite you onto the dev team.

@ericmjl Sure. Doing it right now


Object templates which does not have any localizations

@microsoft-github-policy-service agree [company="{your company}"]
From: microsoft-github-policy-service[bot] @.>
Sent: Thursday, December 29, 2022 3:33 PM
To: microsoft/CSS-SystemCenter-ServiceManager @.>
Cc: name in public profle @.>; Mention @.>
Subject: Re: [microsoft/CSS-SystemCenter-ServiceManager] Object templates with does not have any localizations (PR #8)
@khusmenohttps://github.com/khusmeno please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]
Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
Contributor License Agreement
Contribution License Agreement

This Contribution License Agreement (“Agreement”) is agreed to by the party signing below (“You”),
and conveys certain license rights to Microsoft Corporation and its affiliates (“Microsoft”) for Your
contributions to Microsoft open source projects. This Agreement is effective as of the latest signature
date below.

Definitions.
“Code” means the computer software code, whether in human-readable or machine-executable form,
that is delivered by You to Microsoft under this Agreement.
“Project” means any of the projects owned or managed by Microsoft and offered under a license
approved by the Open Source Initiative (www.opensource.orghttp://www.opensource.org).
“Submit” is the act of uploading, submitting, transmitting, or distributing code or other content to any
Project, including but not limited to communication on electronic mailing lists, source code control
systems, and issue tracking systems that are managed by, or on behalf of, the Project for the purpose of
discussing and improving that Project, but excluding communication that is conspicuously marked or
otherwise designated in writing by You as “Not a Submission.”
“Submission” means the Code and any other copyrightable material Submitted by You, including any
associated comments and documentation.
Your Submission. You must agree to the terms of this Agreement before making a Submission to any
Project. This Agreement covers any and all Submissions that You, now or in the future (except as
described in Section 4 below), Submit to any Project.
Originality of Work. You represent that each of Your Submissions is entirely Your original work.
Should You wish to Submit materials that are not Your original work, You may Submit them separately
to the Project if You (a) retain all copyright and license information that was in the materials as You
received them, (b) in the description accompanying Your Submission, include the phrase “Submission
containing materials of a third party:” followed by the names of the third party and any licenses or other
restrictions of which You are aware, and (c) follow any other instructions in the Project’s written
guidelines concerning Submissions.
Your Employer. References to “employer” in this Agreement include Your employer or anyone else
for whom You are acting in making Your Submission, e.g. as a contractor, vendor, or agent. If Your
Submission is made in the course of Your work for an employer or Your employer has intellectual
property rights in Your Submission by contract or applicable law, You must secure permission from Your
employer to make the Submission before signing this Agreement. In that case, the term “You” in this
Agreement will refer to You and the employer collectively. If You change employers in the future and
desire to Submit additional Submissions for the new employer, then You agree to sign a new Agreement
and secure permission from the new employer before Submitting those Submissions.
Licenses.

Copyright License. You grant Microsoft, and those who receive the Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive, royalty-free, irrevocable license in the
Submission to reproduce, prepare derivative works of, publicly display, publicly perform, and distribute
the Submission and such derivative works, and to sublicense any or all of the foregoing rights to third
parties.
Patent License. You grant Microsoft, and those who receive the Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive, royalty-free, irrevocable license under
Your patent claims that are necessarily infringed by the Submission or the combination of the
Submission with the Project to which it was Submitted to make, have made, use, offer to sell, sell and
import or otherwise dispose of the Submission alone or with the Project.
Other Rights Reserved. Each party reserves all rights not expressly granted in this Agreement.
No additional licenses or rights whatsoever (including, without limitation, any implied licenses) are
granted by implication, exhaustion, estoppel or otherwise.

Representations and Warranties. You represent that You are legally entitled to grant the above
licenses. You represent that each of Your Submissions is entirely Your original work (except as You may
have disclosed under Section 3). You represent that You have secured permission from Your employer to
make the Submission in cases where Your Submission is made in the course of Your work for Your
employer or Your employer has intellectual property rights in Your Submission by contract or applicable
law. If You are signing this Agreement on behalf of Your employer, You represent and warrant that You
have the necessary authority to bind the listed employer to the obligations contained in this Agreement.
You are not expected to provide support for Your Submission, unless You choose to do so. UNLESS
REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING, AND EXCEPT FOR THE WARRANTIES
EXPRESSLY STATED IN SECTIONS 3, 4, AND 6, THE SUBMISSION PROVIDED UNDER THIS AGREEMENT IS
PROVIDED WITHOUT WARRANTY OF ANY KIND, INCLUDING, BUT NOT LIMITED TO, ANY WARRANTY OF
NONINFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
Notice to Microsoft. You agree to notify Microsoft in writing of any facts or circumstances of which
You later become aware that would make Your representations in this Agreement inaccurate in any
respect.
Information about Submissions. You agree that contributions to Projects and information about
contributions may be maintained indefinitely and disclosed publicly, including Your name and other
information that You submit with Your Submission.
Governing Law/Jurisdiction. This Agreement is governed by the laws of the State of Washington, and
the parties consent to exclusive jurisdiction and venue in the federal courts sitting in King County,
Washington, unless no federal subject matter jurisdiction exists, in which case the parties consent to
exclusive jurisdiction and venue in the Superior Court of King County, Washington. The parties waive all
defenses of lack of personal jurisdiction and forum non-conveniens.
Entire Agreement/Assignment. This Agreement is the entire agreement between the parties, and
supersedes any and all prior agreements, understandings or communications, written or oral, between
the parties relating to the subject matter hereof. This Agreement may be assigned by Microsoft.

—
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/CSS-SystemCenter-ServiceManager/pull/8#issuecomment-1367288662, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AANKA5FD7BYS2HIZJ572GFTWPWAJLANCNFSM6AAAAAATMB55V4.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>

@microsoft-github-policy-service agree
From: microsoft-github-policy-service[bot] @.>
Sent: Thursday, December 29, 2022 3:45 PM
To: microsoft/CSS-SystemCenter-ServiceManager @.>
Cc: name in public profle @.>; Mention @.>
Subject: Re: [microsoft/CSS-SystemCenter-ServiceManager] Object templates which does not have any localizations (PR #8)
@khusmenohttps://github.com/khusmeno the command you issued was incorrect. Please try again.
Examples are:
@microsoft-github-policy-service agree
and
@microsoft-github-policy-service agree company="your company"
—
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/CSS-SystemCenter-ServiceManager/pull/8#issuecomment-1367294481, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AANKA5AN56O533TF4WDWIYLWPWBTTANCNFSM6AAAAAATMB55V4.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>


Update Newtonsoft.Json.Bson

The version of Newtonsoft.Json.Bson used by MVC - https://www.nuget.org/packages/Newtonsoft.Json.Bson/1.0.1 - does not support netstandard2.0, and so brings in a big dependency graph.
I'm going to release a new version of Newtonsoft.Json.Bson soon with netstandard2.0 and SourceLink. Should update MVC to use it when it is available.
// @rynowak

My only concern here is that we should try to get this done this week

Decided to push this to 3.0 after discussing with Ryan. There are some things I want to do before the next release of Newtonsoft.Json/Newtonsoft.Json.Bson (inc package signing) and it won't be ready this week.
Since the current package isn't causing a problem for MVC there isn't an urgency. Ca wait for 3.0.


Local Security Policy Directions aren't correct

The directions in Solution 1 say that they are for the local security policy, but they are for a (sort of) group policy.
Step 1 should be changed to open the group policy editor.
Expand Computer Configuration > Policies > Window Settings > Security Settings > Local policies, and then select User rights assignment.
A second option should be added to edit the local security policy, and these settings are under Security Settings > Local Policies > User Rights Assigment.
The user right isn't "Log on locally" it's "Allow log on locally"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e48d6a13-c7f7-20bc-c9da-69b256e8e6f5
Version Independent ID: 436a4ad9-bca2-52bf-eb95-bd20214e7d4e
Content: Azure Active Directory Connect services don't start - Active Directory
Content Source: support/azure/active-directory/services-sync-not-start.md
Service: active-directory
Sub-service: enterprise-users
GitHub Login: @DennisLee-DennisLee
Microsoft Alias: v-dele

Thanks for your feedback, @mrdenny. Responses are inline below:

The directions in Solution 1 say that they are for the local security policy, but they are for a (sort of) group policy.
Step 1 should be changed to open the group policy editor.

Step 1 currently reads "Select Start, enter gpedit.msc in the search box, and then press Enter to open the Local Group Policy Editor snap-in." How is that different from what you think it should be?

Expand Computer Configuration > Policies > Window Settings > Security Settings > Local policies, and then select User rights assignment.
A second option should be added to edit the local security policy, and these settings are under Security Settings > Local Policies > User Rights Assigment.

When I open gpedit.msc (Local Group Policy Editor), "Policies" is not a separate node between "Computer Configuration" and "Windows Settings". Also, the path to the local security options is the basically the same (aside from capitalization, which should match the initial-cap format used in the snap-in). Were there other rights besides the 3 listed that you think should be added?

The user right isn't "Log on locally" it's "Allow log on locally"

You're correct. I'll make this change.

It appears that there are two different ways to open up the local policy editor. One is to run gpedit.msc. The other is to search for "Local Security Policy" and open the editor that way. These will give two different views apparently.
Thank You,
Denny Cherry
Owner & Principal Consultant
Denny Cherry & Associates Consulting, an Inc. 5000 company
<EMAIL_ADDRESS>(o) +1<PHONE_NUMBER>tel:3236861478 | (d) +1<PHONE_NUMBER>tel:2139733669
Online Calendar @./bookings/>
[Logo, company name  Description automatically generated]http://www.dcac.co/
@.
[A picture containing text  Description automatically generated]
[A blue sign with white text  Description automatically generated with low confidence]
From: Dennis Lee @.>
Sent: Friday, May 6, 2022 1:41 AM
To: MicrosoftDocs/SupportArticles-docs @.>
Cc: Denny Cherry @.>; Mention @.>
Subject: Re: [MicrosoftDocs/SupportArticles-docs] Local Security Policy Directions aren't correct (Issue #551)
Thanks for your feedback, @mrdennyhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmrdenny&data=05|01|denny%40dcac.com|6423d5915c3841a1c84808da2f230099|54a77e589bf9475893c794cfd6f0567a|0|0|637874124674989342|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=nFqpUKmnLxdqKSRiP%2BFALnzlDE31nq%2BujIJCtQloXfo%3D&reserved=0. Responses are inline below:
The directions in Solution 1 say that they are for the local security policy, but they are for a (sort of) group policy.
Step 1 should be changed to open the group policy editor.
Step 1 currently reads "Select Start, enter gpedit.msc in the search box, and then press Enter to open the Local Group Policy Editor snap-in." How is that different from what you think it should be?
Expand Computer Configuration > Policies > Window Settings > Security Settings > Local policies, and then select User rights assignment.
A second option should be added to edit the local security policy, and these settings are under Security Settings > Local Policies > User Rights Assigment.
When I open gpedit.msc (Local Group Policy Editor), "Policies" is not a separate node between "Computer Configuration" and "Windows Settings". Also, the path to the local security options is the basically the same (aside from capitalization, which should match the initial-cap format used in the snap-in). Were there other rights besides the 3 listed that you think should be added?
The user right isn't "Log on locally" it's "Allow log on locally"
You're correct. I'll make this change.

Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2FSupportArticles-docs%2Fissues%2F551%23issuecomment-1119277047&data=05|01|denny%40dcac.com|6423d5915c3841a1c84808da2f230099|54a77e589bf9475893c794cfd6f0567a|0|0|637874124674989342|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=VJaInLXkn8YT0aEEoq6JUr2N5OXrqP6ddUOz04G%2Ffcs%3D&reserved=0, or unsubscribehttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAEZIJAQ3I3ZZ6P6NETBHCADVISWGXANCNFSM5U5Y63CQ&data=05|01|denny%40dcac.com|6423d5915c3841a1c84808da2f230099|54a77e589bf9475893c794cfd6f0567a|0|0|637874124674989342|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=lXD%2FLvKiFKJNPlZ1zgbnb6%2BgyqVwGwA4ojNu41AdX64%3D&reserved=0.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>

The policy name correction is now live at One or more Azure Active Directory Connect services don't start. Note that Solution 1 has several changes that go beyond what's addressed here. For that reason we didn't add the local security policy alternate method, since that's just identical to what's done through the local group policy editor and would unnecessarily complicate the solution.


views: make If-Match required on put

Pull Request Test Coverage Report for Build 918470247

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 0.0%

Totals

Change from base Build 526958416:
0.0%

Covered Lines:
0

Relevant Lines:
0

💛  - Coveralls


Added dummy highgui WinRT implementation

highgui is a dependency for tests contribution:

MSOpenTech - #43
Itseez - #4064

This contribution is aiming to provide dummy implementation that would allow test run on WinRT avoiding numerous macro-wrappers disabling highgui dependent code. Thus it should unblock tests contribution referred above.
Subsequent contribution should actually enable highgui related logic for WinRT.

@vpisarev here is ht dummy stup for highgui on WinRT. That should work for the time being to unblock #4064.

:+1:

Thanks @vpisarev, awesome, been waiting for it, @EvgenyAgafonchikov will push an update for "Adding test support for WINRT" #4064 ASAP.


Consolidate and migrate infra to Kubernetes cluster

Summary
Currently our infra is:

The "old" API running in Azure (The "old" bot is already dead)
The CronJob running as a Lambda on @Robin5605's AWS account
The Mainframe running in Azure
Scattered clients running in different places
The bot hosted in @shenanigansd's homelab.

We are ready to merge https://github.com/vipyrsec/infrastructure/pull/10 and deploy our entire stack on a single Kubernetes cluster.
Steps to take before downtime

[x] Create a new Kubernetes cluster on the team's Digital Ocean account. (Do this first so it has time to spin up)
[x] Delete my dev cluster
[x] Delete the "old" API [Azure]
[x] Delete the dragonfly.mantissecurity.org DNS records [Cloudflare]
[x] Delete the dragonfly-staging.vipyrsec.com DNS records [Cloudflare]
[x] Delete the Sentry projects for the "old" bot and API [Sentry]

Steps to take during downtime

[x] Apply pending update to managed DB [Digital Ocean]
[x] Apply the org Helm Chart to the new cluster (https://github.com/vipyrsec/infrastructure/pull/10)
[x] Apply the manifests to the new cluster (https://github.com/vipyrsec/infrastructure/pull/10)
[x] Wait for the ingress to receive it's IP
[x] Update the DNS records for dragonfly.vipyrsec.com with the new IP [Cloudflare]

Steps to take after downtime

[ ] Create user accounts on the Kubernetes cluster for the core team
[ ] @shenanigansd to schedule time to finalize branding and update the email domain from mantissecurity.com to vipyrsec.com` and let PyPI know about the change.

@shenanigansd following up on steps to take after downtime, have we switched to vipyrsec.com as our email domain, and have we let PyPI know about this change yet?

@shenanigansd following up on steps to take after downtime, have we switched to vipyrsec.com as our email domain, and have we let PyPI know about this change yet?

Email domain was handled just now in https://github.com/vipyrsec/dragonfly-mainframe/pull/188

User creation is being handled asynchronously
The scripts used will be added in https://github.com/vipyrsec/infrastructure/pull/39


Removed downloaded and generated data files

Small data examples should be stored in an examples folder. Project data should not, and results should be stored locally, or else in a top-level "data" folder, which has been added to .gitignore and will not be pushed to GitHub.

Codecov Report

Merging #2 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master      #2   +/-   ##
======================================
  Coverage    5.12%   5.12%
======================================
  Files           3       3
  Lines          39      39
======================================
  Hits            2       2
  Misses         37      37

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8ee6a9d...a38be55. Read the comment docs.

These files will still be present in your git history, unfortunately.  This is what I was talking about a while back when I said never to commit large files.  Once they're in the history, you have to rewrite history to get them out.  That's not hard, but it is painful - essentially once you do it, everyone needs to delete their forks and local clones and re-fork/clone.  There are other ways, but that's the simplest one I know of.
Nothing to worry about if these are just a megabyte or so.  Just means slightly longer time to clone/push/pull.


Google Cloud Skills Boost README update

updated some portions of the README

Summary by Sourcery
Enhance the Google Cloud Skills Boost scraper by improving error handling and refactoring the URL handling in the extract_ml_learning_path function. Update the README files to provide clearer instructions, including Windows-specific guidance. Modify the Activity model to support both integer and float durations.
Enhancements:

Improve error handling in the extract_ml_learning_path function by adding try-except blocks for extracting journey details and links.
Refactor the extract_ml_learning_path function to accept a URL parameter and handle missing data gracefully.
Add a command-line interface to prompt the user for the GCSB Journey URL and handle CSV writing with error checking.
Update the Activity model to use Union for the duration field to support both int and float types.

Documentation:

Update the README for the Google Cloud Skills Boost scraper to include Windows-specific instructions and correct module paths.
Add instructions for Windows users to install Microsoft Visual C++ 14.0 or greater in the LLM POC variant README.

@neomatrix369 @TobeTek Ok I may need a walk through with this, I had created 1 branch and within that branch various commits to the various changes but I see now this is confusing because they are showing up within all the PRs I have submitted.  Can one of you please let me know how best to resolve this.  Each PR should be only the 1 change but because it is on the same branch it is showing up as duplicate. Thanks

Hi @asvcode , went ahead to restructure these PRs into #107  and #106 . Here's how I achieved that:

Checkout the Pull Request branch:
Since I don't have a local clone of your fork, I used this command to retrieve the changes from the PR

git fetch origin pull/82/head:gcsb_readme_update

Interactive Rebase to pick desired commits
Using the rebase keywords and dialog we can pick the commits we'd like and rewrite the commit history, viz:

git rebase -i d543b98~1  (Brief guide on rebasing)

I repeated this for each new PR I created.

@TobeTek Perfect! Thank you for that!


Microsoft Authenticator page link is broken

Points to https://www.microsoft.com/account/authenticator and says "We are sorry, the page you requested cannot be found.
The URL may be misspelled or the page you're looking for is no longer available."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 640b9158-3bba-2f76-b9f1-c2660e530062
Version Independent ID: d6d2980d-b36b-9dc3-5c0c-4abed8d19ae2
Content: Download and install the Microsoft Authenticator app - Azure Active Directory
Content Source: articles/active-directory/user-help/user-help-auth-app-download-install.md
Service: active-directory
Sub-service: user-help
GitHub Login: @eross-msft
Microsoft Alias: lizross

@danglund Thank you for your feedback. We will check it with the engineering internally and let you know accordingly.

@eross-msft Could this be rectified ?
The broken link is in the Notes section of this part of the document.

@danglund  Thank you for catching this. I was going through links the other day, removing the locale references for localization, and I stripped the en-us out of this one...which broke it. The correct link is https://www.microsoft.com/en-us/account/authenticator. I am fixing this on the page now, but the fix won't be live until after 3pm this afternoon. Thanks again!


clarify that bash shortcut task only takes command(s)

I found this section confusing:
bash: # script path or inline

From reading that, I expected to be able to write:
bash: my-script.sh

However, that fails because it's not a command. The script has to be executed as a command, like so:
bash: ./my-script.sh

So I'd like that little comment to say:
bash: # command(s)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 07e70665-a794-82fd-287b-65a747488efa
Version Independent ID: 0c34f5c3-bc80-061d-cf7a-f30c224ce3b1
Content: Bash task - Azure Pipelines
Content Source: docs/pipelines/tasks/utility/bash.md
Product: devops
Technology: devops-cicd-tasks
GitHub Login: @steved0x
Microsoft Alias: sdanie

@carlin-q-scott -- Carlin, thank you for your feedback and suggestion.
@steved0x -- Steve, please review these updates in private PR 4740.

That content has moved, here is the new location for the bash task:
https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/bash-v3?view=azure-pipelines
Here is the new location for the bash step (shortcut syntax for using the bash task, which I believe you are referring to)
https://learn.microsoft.com/en-us/azure/devops/pipelines/yaml-schema/steps-bash?view=azure-pipelines
That one has been changed to remove the script path option, since the shortcut is inline script only (potentially using the commands as in your example)
Thank you for letting us know.


Debugger Hangs When Handling Exception in Script Importing Matplotlib

Introduction
Background Information: Encountered a deadlock in vscode-python-debugger when debugging a Python script that raises an exception after importing matplotlib.
Objective: To provide detailed information about a deadlock issue to aid in diagnosing and resolving it.
Environment

Project Version: vscode-python-debugger as included in VSCode 1.86.0
Operating System and Version: Windows 10, Version 21H2 (OS Build 22621)
Dependencies Version: Python 3.11.4, Matplotlib 3.8.1
Browser/Environment: VSCode Version 1.86.0 (user setup), Electron: 27.2.3, Node.js: 18.17.1

Steps to Reproduce

Initial Setup: Configure a Python project with VSCode using pyproject.toml for dependency management and a specific launch.json for debugging.

Action Steps:

Include matplotlib.patches and matplotlib.pyplot in the script.
Implement a try-except block to raise and catch a ValueError.
Start debugging the script using the provided launch.json configuration.

Note: I am interacting with the debugger through keyboard shortcuts.
Script that works as expected:
try:
    raise ValueError("This is a manually raised exception")
except ValueError as e:
    print("Caught exception:", str(e))

Script that hangs once the raised exception breakpoint is reached:
import matplotlib.patches as patches
import matplotlib.pyplot as plt
from matplotlib.figure import Figure

try:
    raise ValueError("This is a manually raised exception")
except ValueError as e:
    print("Caught exception:", str(e))

Note the terminal in the failing script outputs: Backend TkAgg is interactive backend. Turning interactive mode on.

Expected Outcome: The script executes, catching and printing the exception message without any issues.

Actual Outcome: The debugger hangs upon raising the exception. No keyboard input is accepted or registered by VSCode, necessitating manual termination of the debug session.

Additional Context
Configuration Files:

launch.json: Configured for "Python Debugger: Current File" with "integratedTerminal".
pyproject.toml: Specifies Python 3.11 and Matplotlib 3.8.1 among the project dependencies.

Attempts to Resolve

Troubleshooting Steps: Verified that scripts without matplotlib imports do not experience this deadlock.
Workarounds: Currently, avoiding the import of matplotlib in scripts where exceptions are handled allows for normal debugger operation.
Reference to Similar Issues: No similar issues found in the project's issue tracker.

Impact

Severity: Moderate, impacting debugging capabilities for projects utilizing matplotlib. I can work around it my refactoring my code to work around the raised exception.
Urgency: Medium, as it affects developers working on data visualization projects or any project that relies on matplotlib for plotting.

Adding
import matplotlib
matplotlib.use('Agg')

to this script avoids this behavior while keeping the original 3 imports. Not sure why this would be the case. I've run the same version of matplotlib for months now. This behavior began with the most recent debugger update.

Thanks for your bug report @jacobdwyer16. We update debugpy to its last version, maybe thats why you are getting this error now. Thanks for also commenting the solution.


Group fluxtower sites by MODIS tile

Dynamically branch over MODIS tiles to save time when re-running workflow when a site is added.

Just need to check that it ran, took a reasonably similar amount of time (not too much longer than ~1.3 days) and merge the PR


python2.7

There is a problem come from ubuntu coding.

@deadlyaxio
Please, fill issue template.
Can you please elaborate about the issue & the context.Will it be possible to provide related code.Thanks!


fix(elements): remove deprecated componentWillUnload lifecycle method and remove ino-datepicker flatpickr when disconnected

Closes #234
Proposed Changes

substitute all deprecated componentWillUnload() calls with the disconnectedCallback() lifecycle method (as proposed in the bug description)
remove flatpickr from DOM when ino-datepicker component is disconnected

The latter can be tested as follows:

add this code snipped at the end of the ino-datepicker.stories.js file
<button id="removeDatepicker" onclick="console.log('remove all datepickers'); var datepickers = document.querySelectorAll('ino-datepicker'); Array.from(datepickers).forEach(function (datepicker) { datepicker.remove(); });">Remove all datepickers</button>
when clicking the button in the ino-datepicker story within storybook, all appearances of the flatpickr in the DOM tree (shown in the screenshot) should be removed

We should always make sure that the element is defined before we destroy them. Otherwise, we might run into runtime errors. Could you implement such a condition if not already exists?
We could create a helper function like this and use it in every component where we call the destroy function:
destroyIfExists(el?: any): void { // instead of any, is there a generic mdc element type?
	el && el.destroy();
}

The helper function might be overkill, not quite sure

Good idea! I inserted all the corresponding checks. I didn't use a helper function though, because it is quite short (and probably more performant) with the optional chaining operator (e.g. this snackbarInstance?.destroy()).

We should always make sure that the element is defined before we destroy them. Otherwise, we might run into runtime errors. Could you implement such a condition if not already exists?
We could create a helper function like this and use it in every component where we call the destroy function:
destroyIfExists(el?: any): void { // instead of any, is there a generic mdc element type?
	el && el.destroy();
}

The helper function might be overkill, not quite sure

Good idea! I inserted all the corresponding checks. I didn't use a helper function though, because it is quite short (and probably more performant) with the optional chaining operator (e.g. this snackbarInstance?.destroy()).


The "expect-run-verify" reference in the readme links to a dead domain.

See http://monkeyisland.pl/2008/02/01/deathwish/

FWIW - https://web.archive.org/web/20180824034235/http://monkeyisland.pl/2008/02/01/deathwish/


Pin tf-nightly in setup.py

Currently, the following sequence of steps fails:

Create and activate fresh virtualenv
install tfa-nightly
import tensorflow_addons

This raises an op not found error.
I believe this change should fix at least this behavior.

Thanks @jkr26 and sorry for not responding sooner. We had the nightly pinned to an older version for a lot longer than we ever expect to. Going forward the next time we pinn we should include this type of fix so that it's not broken like this.
https://github.com/tensorflow/addons/pull/658 just went in though so all should be good now. Thanks again!


Excessive ; in the code samples

Code samples are formally correct but look unprofessional. Why is each closing '}' in class method's definition followed by a ';'? This is neither grammatically necessary nor a popular stylistic convention. This is usually seen in newbie-level code when people mistakenly believe that that ';' should be there.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 293a9ef1-7673-6e92-bf9c-db3920488af0
Version Independent ID: a70288f2-2829-bd04-3da1-e0a53d58e703
Content: C26495
Content Source: docs/code-quality/c26495.md
Product: visual-cpp
Technology: cpp-tools
GitHub Login: @corob-msft
Microsoft Alias: corob

@TheCalligrapher Thanks for the report. A fix has been published.


Fix qubits indexing in Statevector._evolve_instruction

Summary
Resolves #5282.
Details and comments
#5282 was failing due to bad indexing in _evolve_instruction in case the instruction contains multiple registers.

Also, can you add a release note?


Avoid re-uploading blank artwork

Bug Report
Currently, we upload the text and graphic manager "blank" artwork non-persistently, but we should upload it persistently.
Reproduction Steps

Connect app to head unit and show blank artwork
Ignition cycle the head unit
Connect app to head unit and show blank artwork

Expected Behavior
Only upload the blank artwork once
Observed Behavior
Blank artwork is uploaded every time.
OS & Version Information

Android Version: n/a
SDL Android Version: 5.0.0
Testing Against: n/a

Test Case, Sample Code, and / or Example App
n/a

https://github.com/smartdevicelink/sdl_ios/issues/1864


repository not found

Hello! I use php 7.4.13 and I try to install your package with composer. So, during the installation I have an error:
Cloning into 'neo4j-php-client'...
info: please complete authentication in your browser... // I do this successfully, I have a token from github
remote: Repository not found.
fatal: repository 'https://github.com/transistive/neo4j-php-client.git/' not found

Please help.

Dear Jenya,
Thank you for submitting this issue. Since I was under the assumption that almost no one was using this library at the time, I made a hard reset and started the count from version 1.0 instead of building on top of the graphaware client.
Long story short: Make sure you are using version 1.0 in your composer.json file. This can be done swiftly with these two commands:

composer remove laudis/neo4j-php-client
composer require laudis/neo4j-php-client

Or by simply changing the version in your composer.json file to this: "laudis/neo4j-php-client": "^1.0" and then running composer update.
Please report if this fixes the issue or not, so we can either close the issue or continue problem-solving.
Kind regards,
Ghlen

I do it, and  unfortunatly, I have another error:
    Now trying to download from source
  - Syncing laudis/neo4j-php-client (1.0.0) into cache
info: please complete authentication in your browser...

 1/1 [============================] 100%
Installation failed, reverting ./composer.json and ./composer.lock to their orig
inal content.

  [Symfony\Component\Process\Exception\ProcessTimedOutException]
  The process "git clone --mirror "https://github.com/transistive/neo4j-php-c
  lient.git" "C:/Users/user/AppData/Local/Composer/vcs/https---github.com-tra
  nsistive-neo4j-php-client.git/"" exceeded the timeout of 300 seconds.

No problem, I assume this is going to be a caching issue as I double-checked and it works on my end.
Try these steps in order

delete the composer.lock file
run composer clearcache
remove the line in your composer.json file which contains this line: "laudis/neo4j-php-client": "^1.0"
run composer update
run composer require laudis/neo4j-php-client

If that still does not work I am going to need you to copy and paste the contents of the composer.json file and attach the command you used to install the package.
Best of luck,
Ghlen

Hi Jenya,
I took another hard look and found out I made a misconfiguration on packagist. This is the reason for the error. My apologies for the inconvenience. It should work now :+1:
Greetings,
Ghlen

Hello, transistive . Thank you for improovments! I successfully install your package in my laravel project, connect to neo server and get some records. Works great!
And what about a visual graph representation of query results? As I understand, you are planning to implemet it in future version?
But now, can  I visualize query results as graph with color nodes (like neo4j browser) in my laravel application? Are there any .js libs to do this?
Thanks.

Hi Jenya,
I am glad you like it. Sadly this is a PHP library. The graph representation I am working on will never contain .js solution. It will be an object-oriented, PHP only solution. There is however an example I made that works with the d3.js library to present some movies. That might push you in the right direction. It can be found here. A clone of the end result can be found here.
I am however going to close this issue. If you want to continue this discussion you can always open a new one as we have now left the scope of the initial issue.
Best of luck!
Ghlen


Branch alt-chromeos-5.10 not available

HI,
Where can I find this branch? Or the commit to have audio without sof? Kernel  5.10.???
I guarantee  you have a copy/clone of it. Can you upload somewhere? Yousendit, Mega, etc..
Thanks.
Or if you have a patch??

alt-chromeos-5.10 is not a branch, it's a revision that I've tested to work on my KBL/SKL device. While refactoring, it seems like I forgot that it isn't a branch. In line 42, replace $KERNEL_VERSION with chromeos-5.10. I'll be pushing a fix in a few days, since I'm already working on a huge refactor.

I already tried .... it is downloading about 3 GB and line 43 gives error..

The new refactor is using Powershell on Linux :D. On KBL/SKL, SOF is incompatible. dfw_sst.bin works by just copying it from the ChromeOS rootfs. setup-audio does this automatically, as mentioned in the docs.

the  line...
git checkout $(git rev-list..... chromeos-5.10)
fatal: not a git repository (or any parent up to mount point  /media/username)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM  not set).
fatal: not a git repository (or any parent up to mount point  /media/username)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM  not set).

Add ; cd alt-chromeos-5.10 after Line 43.

you mean chrome-5.10,  al-chrome does not  exist ... as using chromeos-5.10 also for line 42.

I like to work on the kernel without sof for  audio. KBL/APL/SKL
I have the firmware files, cannot retrieve or rebuild the  kernel.
which one can I use?

Which kernel to use  the nonsof kernel... can't get it working... sound
Constantly the error : set reset state failed.: core mask 1
DSP Core power up failed. I can get it working throug SOF, but i that is not my problem.
currently detects nops..

First: are you talking about KBL or APL audio? The detached head state is not an error. You can use the 4.14 or 4.19 branches, but you may need to use an older revision (e.g. from October). I have not tested any of these configurations. Without SOF, pulseaudio can fry your speakers, like they did to you. The only option to not use SOF is on SKL/KBL, where it is not available. On APL, where it does exist, I am not supporting or helping you without SOF. This is uncharted territory. I have tried to support this in #6, but then SOF got supported and I used it. You, and you alone, will need to put in the hours of experimenting needed to replicate the ChromeOS config without SOF. I will be closing this issue if you are asking me about SOF. SOF is great, and being skeptical about it’s firmware blobs is vapid.

KBL is the issue... without sof
How can I get the alt-chromeos-5.10 that's all

You already got it???? The detached head state indicates that it worked.

I just noticed the  build releases... have downloaded them for in case...
with SOF dmic16k would not be enabled and  hotwords also not possbile with SOF. Not all functions of the original will be included.
Bootlogo is working by the way
The kernel is 5.10.54 (changed KERNEL_VERSION=chromeos-5.10 and the ../kernel-alt.conf is 5.10.70 correct???

Yes, the kernel config is 5.10.70???

can you confirm the kernel-alt.conf in the root  of breath (5.10.70) is used for kernel 5.10.54 , which is get by git.

Idk

You can close this! thanks!!


Generated help with aliased group shows abbreviated command in usage

The typical AliasGroup class overrides the get_command method and returns a matching sub command; however, when help is displayed, the usage information shows the matched abbreviated subcommand instead of the full subcommand name. After debugging, I found that the context.info_name contains the the abbreviated sub command name. I think when a sub-command context is being created, it should use the full command name for this field rather than what the user typed.

I believe line 1280 in core.py should be:
    return cmd.name, cmd, args[1:]

instead of:
    return cmd_name, cmd, args[1:]

In an attempt to reproduce this issue, I have tried the following example:
# main.py
class AliasedGroup(click.Group):
    def get_command(self, ctx, cmd_name):
        rv = click.Group.get_command(self, ctx, cmd_name)
        if rv is not None:
            return rv
        matches = [x for x in self.list_commands(ctx)
                   if x.startswith(cmd_name)]
        if not matches:
            return None
        elif len(matches) == 1:
            return click.Group.get_command(self, ctx, matches[0])
        ctx.fail('Too many matches: %s' % ', '.join(sorted(matches)))

@click.command(cls=AliasedGroup)
def cli():
    pass
@cli.command()
def push():
    click.echo('this is push')
@cli.command()
def pop():
    click.echo('this is pop')

if __name__ == '__main__':
    cli()

$ python main.py pu --help
Usage: main.py push [OPTIONS]

Options:
  --help  Show this message and exit.

Based on the above input/output, I am getting the full name of the push subcommand in the Usage part. Therefore, I was not able to reproduce the issue, @davidism.

After triple checking, the example does reproduce the issue, there was some confusion over a few things being worked on at the same time.

Reverted in #1915, see #1895


ddns-updater: Add module and update script

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[x] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/3813

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/3914

Merge conflict was trivial collision in release note, now fixed.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/3936

Merge conflict again introduced in manual and now resolved

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/4009

Updated to latest version of ddns-updater, 2.7.0 and updated release notes to 24.11 instead of 24.05

Hey, thanks for the review!
I'm away from my laptop for a few days but I'll get to this when I'm back to it.
Thanks again.

Hey,
I believe I have made the requested changes, and resolved the latest manual-induced merge conflict.

I have implemented the requested changes, and realized that there was no reason to have a default listening address at all and so removed all default envvars.
Thanks for the time you're putting into reviewing this!

I have implemented the requested changes, and realized that there was no reason to have a default listening address at all and so removed all default envvars.
Thanks for the time you're putting into reviewing this!

@ofborg test ddns-updater

Thanks for your work @NickCao !


Jump to reference doesn't center around the line

Godot version:

3.3 rc6
Issue description:

This is basically another case of #5269 and similar issues.
Steps to reproduce:

Have a script long enough to have scrolling
Do something like

func _ready():
    my_function()

... lots of lines

func my_function():
   pass

Ctrl + Click on my_function() on the top
Editor will jump to my_function() definition, but it will appear at the bottom instead of being centered.

In 4.0 branch, it appears at the first line at the top. Should it be centered ?

Yeah, everything should be centered for consistency.


wtf composer?

What is happening here? I don't want to wait 30-40 seconds each time I want to download this package. And sometimes it takes more than 5 minutes to download, where as I could go to github and download zip or do a simple git clone of the repo and it would take 4-5 seconds to do all that.
I have 8MB connection and github and packagist open up as usual. Most of the time is spent in  Downloading http://packagist.org/p/provider-latest%24d9495326e948cb39d665426388af4fe94f4146eeb6264b3025936565397f8538.json lines, sometimes minutes. Could anyone look at this?
> time composer require mikecao/flight -vvv
Running 1.0.3 (2016-04-29 16:30:15) with PHP 7.0.6 on Linux / 4.5.4-1-ARCH
Reading ./composer.json
Loading config file /home/agauniyal/.config/composer/config.json
Loading config file /home/agauniyal/.config/composer/auth.json
Loading config file ./composer.json
Checking CA file /etc/ca-certificates/extracted/tls-ca-bundle.pem
Executing command (/home/agauniyal/projects/php-proj/flp): git branch --no-color --no-abbrev -v
Executing command (/home/agauniyal/projects/php-proj/flp): git describe --exact-match --tags
Reading /home/agauniyal/.config/composer/composer.json
Loading config file /home/agauniyal/.config/composer/config.json
Loading config file /home/agauniyal/.config/composer/auth.json
Loading config file /home/agauniyal/.config/composer/composer.json
Loading config file /home/agauniyal/.config/composer/auth.json
Reading /home/agauniyal/.config/composer/vendor/composer/installed.json
Downloading https://packagist.org/packages.json
Writing /home/agauniyal/.cache/composer/repo/https---packagist.org/packages.json into cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2013.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2014.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2015.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2015-07.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2015-10.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2016-01.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2016-04.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-archived.json from cache
Downloading http://packagist.org/p/provider-latest%243a018c675355229f6b4cafeec75789c5f0f94de546da2957c26a96715a01d2de.json
Writing /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-latest.json into cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/provider-mikecao$flight.json from cache
Using version ^1.2 for mikecao/flight
./composer.json has been created
Reading ./composer.json
Loading config file /home/agauniyal/.config/composer/config.json
Loading config file /home/agauniyal/.config/composer/auth.json
Loading config file ./composer.json
Executing command (/home/agauniyal/projects/php-proj/flp): git branch --no-color --no-abbrev -v
Executing command (/home/agauniyal/projects/php-proj/flp): git describe --exact-match --tags
Reading /home/agauniyal/.config/composer/composer.json
Loading config file /home/agauniyal/.config/composer/config.json
Loading config file /home/agauniyal/.config/composer/auth.json
Loading config file /home/agauniyal/.config/composer/composer.json
Loading config file /home/agauniyal/.config/composer/auth.json
Reading /home/agauniyal/.config/composer/vendor/composer/installed.json
Loading composer repositories with package information
Downloading https://packagist.org/packages.json
Writing /home/agauniyal/.cache/composer/repo/https---packagist.org/packages.json into cache
Updating dependencies (including require-dev)
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2013.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2014.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2015.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2015-07.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2015-10.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2016-01.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-2016-04.json from cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-archived.json from cache
Downloading http://packagist.org/p/provider-latest%24d9495326e948cb39d665426388af4fe94f4146eeb6264b3025936565397f8538.json
Writing /home/agauniyal/.cache/composer/repo/https---packagist.org/p-provider-latest.json into cache
Reading /home/agauniyal/.cache/composer/repo/https---packagist.org/provider-mikecao$flight.json from cache
Resolving dependencies through SAT
Dependency resolution completed in 0.000 seconds
Analyzed 48 packages to resolve dependencies
Analyzed 73 rules to resolve dependencies
  - Installing mikecao/flight (v1.2.20)
Reading /home/agauniyal/.cache/composer/files/mikecao/flight/ed5fbb05842846b943467db5371829615a82adb7.zip from cache
    Loading from cache
    Extracting archive
Executing command (CWD): unzip '/home/agauniyal/projects/php-proj/flp/vendor/mikecao/flight/628fc647097ad1745f2b58d413dfa750' -d '/home/agauniyal/projects/php-proj/flp/vendor/composer/c404cb64' && chmod -R u+w '/home/agauniyal/projects/php-proj/flp/vendor/composer/c404cb64'

    REASON: Required by the root package: Install command rule (install mikecao/flight v1.2|install mikecao/flight v1.2.13|install mikecao/flight v1.2.14|install mikecao/flight v1.2.15|install mikecao/flight v1.2.17|install mikecao/flight v1.2.18|install mikecao/flight v1.2.19|install mikecao/flight v1.2.20)

Reading /home/agauniyal/projects/php-proj/flp/vendor/composer/installed.json
Writing lock file
Generating autoload files

real	0m39.585s
user	0m1.020s
sys	0m0.063s

Is it only with Flight? Just did the same: 0.81s user 0.29s system 10% cpu 10.276 total
I think it's more related to https://github.com/composer/packagist

Issue must be between you and packagist
real	0m2.242s
user	0m1.356s
sys	    0m0.072s

I've already disabled xdebug since the first run of composer (it asked to do so by flashing a warning), and I've also tried laravel installation which pulls in much more than this does and but is somewhat faster than flight installation since it is downloading more packages? I've tried restarting my router several times, migrated to google dns but the problem is still with those json files :astonished:

For the time being if anyone could tell me how to restructure flight after cloning from github so that it appears same as downloaded from composer, it would be very very helpful :smile:

I'm quite new to this composer thing, but is it really slow?

No two people have commented with our timed runs of composer require mikecao/flight and they are well within what's considered acceptable

I asked my friend who has different ISP to try the same and he had worse results. His download took about 51 seconds and was probably thinking composer wasn't even working. I'll try to find what's happening under the hood and maybe with some luck I could report with better results. Thankyou for your patience, till that I'll work with git clone :smile:


OpenIMSCore status error

Hi
I'm using Open Baton and OpenStack.
OpenStack is multi node architecture and Open Baton is running on OpenStack as VM.
I have tested Open Baton and OpenStack to deploy iPerf and SIPp successfully (I see Open Baton shows Active state in NS Record menu).
I have tried to test OpenIMSCore but without any luck I get ERROR state from Open Baton NS Record menu and from the log I see:
ERROR from VNFM: java.lang.RuntimeException: No EMS yet for host with extracted host ID: 8173172
I'm interested to hear from you.
I have attached some logs from openbaton.log and cloud-init.log please have a look and share your idea please, after some try I couldn't figure out what the problem is
openIMScore_log-failed&SIPp_successfull.zip

Hi guys
I have solved the problem, It seems the issue was on OpenIMScore image,
I'm using ubuntu 14.0.4 cloud image now and it's working well.


"Unable to read Dart source"?

I don't think I was doing anything particularly noteworthy, I just tried to start a random app I'd written, and got the following (nothing ran on the device as far as I saw):
$ flutter --local-engine 'android_debug_unopt' run --pid-file /tmp/run.pid
Running 'pub get' in dummy...                        483ms
Building APK in debug mode (android_debug_unopt)...
Warning: signing the APK using the debug keystore.
Built build/app.apk (9.2MB).
Launching loader on Nexus 6...
--------- beginning of system
W/ActivityManager: Permission Denial: Accessing service ComponentInfo{com.google.android.music/com.google.android.music.dial.DialMediaRouteProviderService} from pid=9788, uid=10090 that is not exported from uid 10070
Observatory listening on http://<IP_ADDRESS>:8100
Diagnostic server listening on http://<IP_ADDRESS>:8101
W/ActivityManager: Scheduling restart of crashed service com.google.android.gms/.feedback.FeedbackService in 1000ms
I/flutter : [INFO:SkFontMgr_android.cpp(163)] Requested font file /system/fonts/DroidSansFallback.ttf does not exist or cannot be opened.
I/flutter :
Syncing files to device...                           3198ms
Synced 5.2MB.
Connected to _flutterView/0xa80163b0.
Running lib/main.dart on Nexus 6...
E/flutter : [ERROR:../../lib/tonic/file_loader/file_loader.cc(155)] error: Unable to read Dart source 'package:flutter/rendering.dart'.
W/flutter : LEAK: 20 RenderObject
Application finished.
W/ActivityManager: Force removing ActivityRecord{aac47b2 u0 com.yourcompany.dummy/org.domokit.sky.shell.SkyActivity t363}: app died, no saved state
W/ActivityManager: Unable to start service Intent { act=com.urbanairship.location.ACTION_CHECK_LOCATION_UPDATES cmp=uk.co.economist/com.urbanairship.location.LocationService (has extras) } U=0: not found

cc @johnmccutchan

@Hixie was this a one-off failure or repeatable? We may have a race where we are still writing files to DevFS while we are launching.

I only noticed it once yesterday.

I haven't seen this in along time.
One thing of note is that on Android we are using a directory that the system can choose to clear at anytime.

Going to close this since I don't see it anymore. Please reopen if it's something for which we could add defense in depth and make the error case more graceful.

I suspect @Hixie didn't have any spaces or characters other than plain alpha-numerics in his paths, but for future archaeologists, this typically occurs when:

paths contain spaces, accented characters, etc.
an imported file is missing when the vm tries to load it

The fix to 1 is tracked by #6577, fixed in the engine by flutter/engine#4650.


generate_quantities handles save_warmup=True "wrong".

Summary:
If save_warmup=True, generate_quantities takes the first num_samples warmup and samples to generate the gqs.
https://github.com/stan-dev/cmdstan/blob/develop/src/cmdstan/command.hpp
    size_t num_cols = param_names.size();
    size_t num_rows = fitted_params.metadata.num_samples;
    // check that all parameter names are in sample, in order
    if (num_cols + hmc_fixed_cols > fitted_params.header.size()) {
      msg << "Mismatch between model and fitted_parameters csv file \"" << fname
          << "\"" << std::endl;
      throw std::invalid_argument(msg.str());
    }
    for (size_t i = 0; i < num_cols; ++i) {
      if (param_names[i].compare(fitted_params.header[i + hmc_fixed_cols])
          != 0) {
        msg << "Mismatch between model and fitted_parameters csv file \""
            << fname << "\"" << std::endl;
        throw std::invalid_argument(msg.str());
      }
    }
    return_code = stan::services::standalone_generate(
        model,
        fitted_params.samples.block(0, hmc_fixed_cols, num_rows, num_cols),
        random_seed, interrupt, logger, sample_writer);

Has to be changed into something that handles this differently, also incorporating the thinning parameter.
Current Version:
v2.26.1

answer to above question:  stan::io::stan_csv_reader::read_samples isn't doing what I though it was.
it reads from the beginning of the file and assembles all draws into the Eigen Xd matrix.
the metadata has fields num_warmup, save_warmup, and num_samples.
therefore, two options:
a) use all draws
b) add argument to flag whether or not to use warmup draws.
a) is a whole lot easier.  given that by default, warmup draws are not saved, if warmup draws are present, then that's a deliberate choice, and standalone GQ should use all draws.

Ie reading of the adaptation does not seem to work when warmup draws have been saved. But I have made no tests and my understanding is very shallow.

it's not your understanding that's shallow - it's the code.  no comments.  haven't checked out the unit tests - probably not enough of them, either.

going with option a) then, draws in the fitted_params csv file will be used, all of them.
CmdStanPy will have to document this, and could also print info message to user that warmup draws are present.
if CmdStanPy wants to get fancier, it could - I suggest we don't and push back on Python users to do their own data munghing.

Yes, I would not want to deal with data wrangling in C...


What is the best way to add more Gigs to PVC ? without any downtime

for example i have this volume claim already mounted:
    volumeClaimTemplates:
      - name: data-storage-vc
        persistentVolumeClaim:
          metadata:
            name: USE_DEFAULT_NAME
        spec:
          storageClassName: encrypted-gp2 # USING AN ENCRYPTED EBS VOLUME
          volumeMode: Block
          accessModes:
            - ReadWriteOnce
          resources:
            requests:
              storage: 900Gi

what is the best way to increase/add storage request without any downtime?

you should have CSI PVC Provisioner which supports resize operation
and your storage class should contains allowVolumeExpansion: true
you need to add
reclaimPolicy: Retain to your claim template data-storage-vc
also, you need minimum 2 replicas for each of your shard in the cluster layout
after it, just apply the new version of the manifest with increased data size
clickouse-operator will apply changes to each PVC sequentially
and it will need to restart clickhouse-server only one replica in each shard in the same time
you should need to run experiment in your staging environment before apply manifest in production
also, your application should have ability to re-run failed insert statements (with the same data) during data ingestion


Add button to toggle footer

Like with #45, this makes sense as a button on the final output.

Closed in ce1c258b8def770cb17d2671571ac89b773827bf


Audit Py methods for GIL safety

As part of the invariant that Py<T>'s data can only be accessed when the GIL is locked, all the member functions should either acquire the GIL or take a GIL token as an argument. Py::get_refcnt and several of the unsafe functions doesn't appear to lock the GIL internally.
Note that it is Undefined Behavior to read the reference count using a plain memory read (what ffi::Py_REFCNT does) while a different thread is concurrently modifying it, making get_refcnt have safety issues.
Originally posted by @programmerjake in https://github.com/PyO3/pyo3/pull/948#issuecomment-637353345
Proposed actions to resolve this:

Add Python token as an argument to all safe function that require the GIL.
Add # Safety documentation to all unsafe functions that require the GIL. (Or alternatively add Python token argument to them too.)

There are similar issues for PyObject::get_refcnt and probably other member functions.


ES2015 "=>" operator can not be handled by gulp-vulcanize

Hello. I am using gulp-vulcanize to pack my app.
Once I import the paper-datatable: bower install --save paper-datatable and use html import to my  app, gulp-vulcanize fails with error:
Error: no writecb in Transform class

I traced the code and find the reason was => symbol in the code (e.g. line 567)
The command line version vulcanize can do the trick but I wonder how to make gulp-vulcanize do the samething?

not vulcanize problem #18 closed


Bugfix: Country Report tidyverse dependency

Expected Behavior
Local installation of {gsm} should render country report.
Current Behavior
Local installation of {gsm} throws a tidyverse dependency issue when rendering the report since tidyverse isn't a {gsm} dependency.
Resolution
Modify the line here to use specific packages within tidyverse explicitly.

Same issue with the QTL report locally:

This specific issue can probably be resolved by including library(purrr) and using purrr::discard().

processing file: KRIReportByQTL.Rmd
  |................................                                                                                |  15% [unnamed-chunk-1]
Quitting from lines 19-38 [unnamed-chunk-1] (KRIReportByQTL.Rmd)
Error in `discard()`:
! could not find function "discard"
Backtrace:
 1. ... %>% unique()
 2. base::unique(.)

Closed via #1331


Change gridsome's requirement for node versions from 8.x to 12.x

Summary
Change gridsome's requirement for node versions from 8.x to 12.x.
https://github.com/gridsome/gridsome/blob/9b77f76057b9f3d343fb732fae4c9bf0b6b71657/package.json#L33
Motivation
Node 8.x reached its stated end point back on 2019-12-31. This happened more than a year ago. Its successor, 10.x, also ended its life four months ago (2021-04-30).
Gridsome is still stuck at 8.x. Providing support for versions of node that are no longer maintained is a heavy burden, and gridsome should not try to support older node LTS versions.
Always follow the oldest LTS that is still under maintenance is the best choice. Now let's go to 12.x

Done 👍
https://github.com/gridsome/gridsome/commit/10c5ac1eef96e6c7f62f5be86dbf468a21d7d043


340_observers_cannot_vote_3_test takes ages on Docker 1.11.0-rc4

Test ./340_observers_cannot_vote_3_test.sh finished with success after 191.6 secs

Seems to have been a one-off. -> worksforme


Add phase tree plot

Codecov Report
Patch coverage is 100.00% of modified lines.

Files Changed
Coverage

src/sdr/_modulation/_msk.py
ø

src/sdr/_modulation/__init__.py
100.00%

:loudspeaker: Thoughts on this report? Let us know!.


sign metric

🚀 Feature Request
We should add sign metric defined as  mean(sign(y_true - y_pred)). sign(0) == 0
Motivation
Sometimes in case of transformation we get quite shifted forecasts.
It seems we can control this behaviour with such metrics.
Proposal

add functional metric def sign(y_true: ArrayLike, y_pred: ArrayLike) -> float to etna.metrics.functional_metrics
add metric class Sign(Metric) to etna.metrics.metrics

Test cases

test Sign metric in both macro and per-segment modes
test Sign in backtest

Alternatives
No response
Additional context
No response
Checklist

[ ] I discussed this issue with ETNA Team

looks like we don't need test the metric in backtest as soon as we test both macro and per-segment modes in __call__


High-level convert function?

From today discussion with @akariv I've got an idea to have simple high-level function-wrapper (instead of initiating Model class etc):
jsontableschema.convert(schema, data)

validate and infer are already here so convert could play the similar role.

I don't think it's a good idea anymore for now (based on FD API plan). So please re-open if someone feels it's needed.


aggregate return empty

when i create aggregate with aggregate method i get empty data
$query = Query::matchAll(); $product_query = Products::searchQuery($query)             ->size(0)             ->aggregate('stock_statuses', [                 "terms" => [                     "field" => "status"                 ]])->execute();          return $product_query->aggregations();
returns :
"stock_statuses": {}
but when i replace aggregations with raw method like this aggregations object return successfully:
   $query = Query::matchAll();         $product_query = Products::searchQuery($query)             ->size(0)             ->aggregate('stock_statuses', [                 "terms" => [                     "field" => "status"                 ]])->execute();          return $product_query->raw();
returns to me:
 {         "took": 0,         "timed_out": false,         "_shards": {             "total": 1,             "successful": 1,             "skipped": 0,             "failed": 0         },         "hits": {             "total": {                 "value": 10000,                 "relation": "gte"             },             "max_score": null,             "hits": []         },         "aggregations": {             "stock_statuses": {                 "doc_count_error_upper_bound": 0,                 "sum_other_doc_count": 0,                 "buckets": [                     {                         "key": "active",                         "doc_count": 128168                     }                 ]             }         }     }

Hey @sbh96, I can't reproduce the issue. I've tried the parser with your raw response and I was able to get buckets and other fields like this:
// array of fields
$searchResponse->aggregations()->get('stock_statuses')->raw();
// collection of buckets
$searchResponse->aggregations()->get('stock_statuses')->buckets();

Please make sure you use the latest package version.


CSV file verification information addition

As mentioned by the user, I added a note regarding the CSV file.
Problem: https://github.com/MicrosoftDocs/windows-itpro-docs/issues/5510

@JohanFreelancer9 for copy review. Thank you.

Ready to go live.

@JohanFreelancer9 : it looks like your suggestion got marked as resolved without those changes being committed, except for the spacing from my suggestion. Are you OK with this decision?

@illfated - Not really. Here's why:

Intune is a product name and should be capitalized.
Always spell out ordinal numbers (1st) in accordance with the Microsoft Style Guide.
listed items should not be capitalized (refer to https://docs.microsoft.com/intune/enrollment/enrollment-autopilot where the same items are listed.

Suggestion applied. Thanks @JohanFreelancer9 . When I have applied previous commits the last commits show as outdated and I looked for the details where it was pointing to language locale which was then removed by editing the file and commit that patch in current PR.
We are all set now and ready to go live.

Hi @greg-lindsay for your review and approval. Please merge if you see no issues with this PR.
Happy holidays!


Add local network files to gitginore upon zos init

We are only adding .zos.session to the gitignore file when running zos init. To be consistent with the suggestions in our docs (see https://github.com/zeppelinos/zos/pull/361/files), we should add zos.dev-*.json files to .gitignore as well.

This is an easy win, reducing the need to side-track the user by having to explain what these are.


Video from webcam not showing

I am unable to see the video from my webcam...i tried index file for step01 folder bt still am unable to see a video ..

@gurbaaj could you provide more details on how you are running this?
Are you running this from a server or localhost (this only works in https / localhost)? Any errors in console? What browser and operating system are you using?

I'll close this now, but feel free to open an issue if you're still experiencing problems.


model with function API

Hi this is really great work!
I just want to provide something I find might be useful to others.
I find that in order to dump model correctly. We need to build model with sequential model and add Activation layer separately.
For example, the second method will get dumped correctly. While for the first method, dumped model has no Activation layer.
from keras.models import Sequential, Model
from keras.layers import Input, Dense, Dropout, Activation
def get_model_by_sequential():
model = Sequential()
model.add(Dense(64,input_dim=15,init = 'uniform',activation='relu'))
model.add(Dense(128,init = 'uniform',activation='relu'))
model.add(Dense(256,init = 'uniform',activation='relu'))
model.add(Dense(1,activation='sigmoid'))
return model
def get_model_by_sequential_with_Activation():
model = Sequential()
model.add(Dense(64,input_dim=15,init = 'uniform'))
model.add(Activation('relu'))
model.add(Dense(128,init = 'uniform'))
model.add(Activation('relu'))
model.add(Dense(256,init = 'uniform'))
model.add(Activation('relu'))
model.add(Dense(1))
model.add(Activation('sigmoid'))
return model
def get_model_by_functional_API():
a = Input(shape=(15,))
b = Dense(64,input_dim=15,init = 'uniform',activation='relu')(a)
b = Dense(128,init = 'uniform',activation='relu')(b)
b = Dense(256,init = 'uniform',activation='relu')(b)
b = Dense(1,activation='sigmoid')(b)
model = Model(input=a, output=b)
return model

Thanks for that information! I think it should be easy to handle both situations. Would you like to prepare changes for it?

Hi, I will work on that. I also added 'sigmoid' Activation layer for binary classification.


Sync with upstream nng #2

Codecov Report
Base: 55.74% // Head: 55.74% // Decreases project coverage by -0.01% :warning:

Coverage data is based on head (00f0519) compared to base (19b697a).
Patch coverage: 77.77% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #138      +/-   ##
==========================================
- Coverage   55.74%   55.74%   -0.01%
==========================================
  Files          95       95
  Lines       24887    24892       +5
==========================================
+ Hits        13874    13876       +2
- Misses      11013    11016       +3

Impacted Files
Coverage Δ

src/sp/transport/tcp/tcp.c
72.19% <33.33%> (+1.15%)
:arrow_up:

src/core/dialer.c
82.71% <100.00%> (+0.14%)
:arrow_up:

src/core/socket.c
85.89% <100.00%> (-0.04%)
:arrow_down:

src/sp/protocol/pair0/pair.c
90.27% <100.00%> (+0.07%)
:arrow_up:

src/platform/posix/posix_tcpconn.c
75.00% <0.00%> (-4.75%)
:arrow_down:

src/sp/transport/inproc/inproc.c
78.35% <0.00%> (-1.87%)
:arrow_down:

src/core/aio.c
91.89% <0.00%> (-1.21%)
:arrow_down:

src/sp/protocol/pair1/pair.c
93.27% <0.00%> (-0.62%)
:arrow_down:

src/platform/posix/posix_ipcconn.c
56.16% <0.00%> (-0.46%)
:arrow_down:

src/core/stats.c
81.70% <0.00%> (-0.43%)
:arrow_down:

... and 5 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Feedback for "SAP Business Technology Platform"

https://help.sap.com/products/BTP/65de2977205c403bbc107264b8eccf4b/6a2c1ab5a31b4ed9a2ce17a5329e1dd8.html?locale=en-US
Hi, I tried to download PDF Version of SAP BTP documentation, but I didn't get any response.
Could you check it please?

Hi José,
Thanks for the feedback, and we will look into this issue. In the meantime, you can open and download the PDF from the following URL: https://help.sap.com/doc/bd6250c40c9c4c5391e3009a6f26dc3b/Cloud/en-US/SAP_Cloud_Platform.pdf.
Sincerely,
Nikola

@nikolasimeonov77 Hi Nikola, the issue is known and currently being fixed (https://sapjira.wdf.sap.corp/browse/DPS-12424). Best regards, Kathrin

Hi José, Thanks for the feedback, and we will look into this issue. In the meantime, you can open and download the PDF from the following URL: https://help.sap.com/doc/bd6250c40c9c4c5391e3009a6f26dc3b/Cloud/en-US/SAP_Cloud_Platform.pdf.
Sincerely, Nikola

Ok Nikola, many thanks.

Thank you for reporting this issue. It is fixed now.
Sincerely,
Nikola

https://people.sap.com/josereynaldo.bautistapalomino


Fix: Make the developer guide less outdated

We should document the MCDev IntelliJ plugin, since that's what I use to browse NBT. I'm not sure if there's something similar for VS Code.


Follower cannot hit mv after alter table operation

Steps to reproduce the behavior (Required)

Create test table and insert test data:

CREATE TABLE IF NOT EXISTS demo.example_tbl
(
    `user_id` LARGEINT NOT NULL COMMENT "用户id",
    `date` DATE NOT NULL COMMENT "数据灌入日期时间",
    `last_visit_date` DATETIME NOT NULL DEFAULT "1970-01-01 00:00:00" COMMENT "用户最后一次访问时间",
    `city` VARCHAR(20) COMMENT "用户所在城市",
    `age` SMALLINT COMMENT "用户年龄",
    `sex` TINYINT COMMENT "用户性别",
    `cost` BIGINT DEFAULT "0" COMMENT "用户总消费",
    `max_dwell_time` INT DEFAULT "0" COMMENT "用户最大停留时间",
    `min_dwell_time` INT DEFAULT "99999" COMMENT "用户最小停留时间"
)
PRIMARY KEY(`user_id`, `date`, `last_visit_date`)
PARTITION BY RANGE(`date`)
(PARTITION p20171001 VALUES [("2017-10-01"), ("2017-10-02")),
 PARTITION p20171002 VALUES [("2017-10-02"), ("2017-10-03")),
 PARTITION p20171003 VALUES [("2017-10-03"), ("2017-10-04")))
DISTRIBUTED BY HASH(`user_id`) BUCKETS 1;

insert into demo.example_tbl values
(10000,'2017-10-01','2017-10-01 06:00:00','北京',20,0,20,10,10),
(10000,'2017-10-01','2017-10-01 07:00:00','北京',20,0,15,2,2),
(10001,'2017-10-01','2017-10-01 17:05:45','北京',30,1,2,22,22),
(10002,'2017-10-02','2017-10-02 12:59:12','上海',20,1,200,5,5),
(10003,'2017-10-02','2017-10-02 11:20:00','广州',32,0,30,11,11),
(10004,'2017-10-01','2017-10-01 10:00:15','深圳',35,0,100,3,3),
(10004,'2017-10-03','2017-10-03 10:20:22','深圳',35,0,11,6,6);

Check test table partition visible version time in partitions_meta for leader:

Execute alter table:

alter table demo.example_tbl add column name varchar(64);

Create materialized view:

CREATE MATERIALIZED VIEW demo.example_tbl_view_test_city
REFRESH ASYNC START("2024-06-21 00:00:00") EVERY(INTERVAL 1 HOUR)
PARTITION BY `date`
AS
select `date`,`city`,count(1) from demo.example_tbl group by 1,2;

Start a new follower:

./bin/start_fe.sh --helper ip:9010 --daemon

Check test table partition visible version time in partitions_meta for both leader and new follower:

Execute sql to check mv hit, leader hit view, follower cannot:

explain select city,count(1) from demo.example_tbl where `date`='2017-10-01' group by 1

Expected behavior (Required)
Both leader and follower can hit mv.
Real behavior (Required)
Query on leader can hit the mv
Query on new follower cannot hit the mvn

StarRocks version (Required)
3.3.0

I've read the related code, the main reason for this problem is: alter table job does not record partition visible version time in edit log, when start a new follower, the follower synchronize replay job by current machine timestamp instead from leader, which lead to inconsistent partition visible version time for leader and follower. This lead to mv hit failed. Here is the log from leader and follower of replay job:

In method 'LakeTableAlterMetaJobBase#updateVisibleVersion', 'visibleVersionTime' would updated by current timestamp. And finally compare faild in this method:
    private static boolean isBaseTableChanged(String mvName, Partition partition,
                                              MaterializedView.BasePartitionInfo mvRefreshedPartitionInfo) {
        boolean result = partition.getVisibleVersion() != mvRefreshedPartitionInfo.getVersion()
                || partition.getVisibleVersionTime() > mvRefreshedPartitionInfo.getLastRefreshTime();
        return result;
    }

'partition' is comes from follower info, 'mvRefreshedPartitionInfo' is comes from view meta which synchronized from leader edit log.


common.py does not properly accept AAT_USE_CPP=ON

Currently in common.py the AAT_USE_CPP variable is normalised via lower(), however it is compared against the capitalised value ON instead of on, thereby never properly being checked (will always be False). I can fix this in my next PR, though it is not actually topical to it, as it is trivial enough.
ref: https://github.com/AsyncAlgoTrading/aat/blob/647d1a647e6721f6c139e3a516a0e5af45167dba/aat/common.py#L16

Fixed in commit 2fbc0c7

Fixed in 2fbc0c7


Improvement - Optional Parameters for Commands with Date Ranges

Changes
This PR changes the parsing of freebetween and appointmentsbetween to allow specification of only a subset of the start or end dates and times.
Related Issues

Closes #230

Codecov Report

Merging #231 (e25904d) into master (b666fbb) will increase coverage by 0.11%.
The diff coverage is 93.10%.

@@             Coverage Diff              @@
##             master     #231      +/-   ##
============================================
+ Coverage     71.91%   72.03%   +0.11%
- Complexity     1174     1178       +4
============================================
  Files           156      156
  Lines          3618     3622       +4
  Branches        440      445       +5
============================================
+ Hits           2602     2609       +7
+ Misses          944      942       -2
+ Partials         72       71       -1

Impacted Files
Coverage Δ

...logic/parser/AppointmentsBetweenCommandParser.java
95.23% <90.90%> (+0.23%)
:arrow_up:

.../contax/logic/parser/FreeBetweenCommandParser.java
95.65% <91.66%> (+0.41%)
:arrow_up:

...tax/logic/commands/AppointmentsBetweenCommand.java
100.00% <100.00%> (ø)

...eedu/contax/logic/commands/FreeBetweenCommand.java
100.00% <100.00%> (ø)

...tax/model/appointment/DisjointAppointmentList.java
97.32% <0.00%> (+2.67%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b666fbb...e25904d. Read the comment docs.


Improve search and error handling

Handle GUI direction on empty search results or search error
Direct back to search results after an action is taken on a search result
Search caching:

Search results should not be cached, IMO

Generally, handle all service response related errors

Looks good for me - tests works perfect.

Thank you very much (again)


Display container tag to promote

@m-bull and I discussed this this morning - we think whitespace may be the cause of some of the noop runs. How about using dev_pulp_repository_container_promotion_tag.strip() to remove any whitespace?

We can do this separately.

@m-bull and I discussed this this morning - we think whitespace may be the cause of some of the noop runs. How about using dev_pulp_repository_container_promotion_tag.strip() to remove any whitespace?

We can do this separately.

https://github.com/stackhpc/stackhpc-release-train/pull/167


Make local variable to evaluate dynamically

Description
[Describe what this change achieves - Guidelines below (please delete the guidelines after writing the PR description)]

What is the change? This is best described in terms of “Currently, Babelfish does X. With this change it now does Y.” Think of “What did it used to do?” and “What does it do now?”

Why was the change made? What drove our desire to put effort into the change?
How was the code changed should only appear for large commits. This can serve as a rough roadmap to what’s contained in the commit. It should be very high level; if it’s directly referencing code it’s probably too detailed. It’s also critical that this section of a commit message does not try to replace proper code documentation (ie, block comments or README files). Generally, this section should only appear if the commit itself is large enough that it’s helpful to provide a roadmap to someone looking at the commit.
The last descriptive piece is the “title” for the commit: the very first line of the commit message, which should typically be less than 80 characters. A good title is critical, because it’s the only thing that shows up in places like the Github commit listing. No one’s got time to read through full commit messages when trying to find a single commit out of dozens.

Issues Resolved
[List any issues this PR will resolve]
Test Scenarios Covered

Use case based -

Boundary conditions -

Arbitrary inputs -

Negative test cases -

Minor version upgrade tests -

Major version upgrade tests -

Performance tests -

Tooling impact -

Client tests -

Check List

[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is under the terms of the Apache 2.0 and PostgreSQL licenses, and grant any person obtaining a copy of the contribution permission to relicense all or a portion of my contribution to the PostgreSQL License solely to contribute all or a portion of my contribution to the PostgreSQL open source project.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>5
Warning: This coverage report may be inaccurate.
This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

116 of 118 (98.31%)  changed or added relevant lines in 3 files are covered.
941 unchanged lines in 4 files lost coverage.
Overall coverage increased (+0.03%) to 74.515%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

contrib/babelfishpg_tds/src/backend/tds/tdsresponse.c
4
5
80.0%

contrib/babelfishpg_tsql/src/tsqlIface.cpp
98
99
98.99%

Files with Coverage Reduction
New Missed Lines
%

contrib/babelfishpg_tds/src/backend/tds/tdsutils.c
1
73.8%

contrib/babelfishpg_tsql/src/hooks.c
10
83.24%

contrib/babelfishpg_tsql/src/tsqlIface.cpp
283
90.0%

contrib/babelfishpg_tsql/src/pl_exec.c
647
44.42%

Totals

Change from base Build<PHONE_NUMBER>5:
0.03%

Covered Lines:
45254

Relevant Lines:
60731

💛  - Coveralls

I tried a random query in MSSQL and I got different results (see review comment).
Also requesting to include tests where SELECT and UPDATE with dependent variables against an actual table, as in a stored procedure.

Yes, There is diff in UPDATE tests cases which is expected and being worked upon with https://github.com/babelfish-for-postgresql/babelfish_extensions/pull/3028. We have added test cases for test SELECT/INSERT as well as stored procedure


ICCS Summer School presentation, draft 2

[ ] [Achintya] Tweaks to Motivating Problems

[ ] Sharper figure for the bogus data sources CSV – AR: We’ll need to host images elsewhere. Will return to this.

[ ] [Roly] Relate each demo to motivating problems established earlier

[ ] Discussion points for each demo – e.g. “transparent” brushing and linking, explaining algorithms
[ ] Convolution example – show behaviour with different filter?

[ ] [Caveat slide]

[ ] Perhaps we can (slowly) bring about structural change, by changing norms/expectations about what we mean by “open” and “transparent”
[ ] Maybe this would work better as a closing slide?

[ ] Contributing to Fluid development

Show how .js data binding works
Go through generalising ScatterPlot to BubbleChart?

[ ] Moving forward

[x] How can we help you tell a story with your data?

[ ] How can we make something you’ve already done more valuable?
[ ] Is there something you wanted to explore but didn’t?

[ ] Other ways to contribute

Done/dropped:

[x] [Achintya] Maybe move “Kinds of Users” section to after Fluid demos and before “Authoring with Fluid”? – AR: Have moved it to after Authoring. Will explain when we speak on Friday!
[x] [Achintya] Tweaks to Motivating Problems

[x] Present the “pristine rainforest” bit as peeling back a layer? – AR: Tell me what you think of my edits.
[x] (Perhaps) add methane emissions/hydroelectric example alongside (as separate example on same slide)
[x] On same slide, perhaps mention that software can’t solve these problems (but can help present this kind of information in a revealing way) – AR: Added to end of section.
[x] “Reproducing IPCC reports with open data” overlaps both with earlier IPCC examples and earlier reproducibility example. Perhaps instead reframe it as an illustration of the “state of play” today, i.e. effort involved in finding/downloading data, writing your own R scripts, etc – we want to put this power in the hands of readers
Replace PDF link by screenshot? – AR: Kept PDF. Will explain reason in person!

[x] [Achintya] Target users

[x] Slide/diagram with different kinds of user and subcategories within those, e.g.:

[x] readers vs. authors
[x] scientists vs. policy makers vs. journalists vs. publishers
[x] specific scenarios we care about, e.g. persistent/shareable interactions for peer review

[x] How existing toolchains support these users today? – AR: This comes under discussion of authors and future authoring paradigms.

@RaoOfPhysics To get the “standalone image URLs” running locally, do yarn publish-standalone and then yarn serve-app. (That may assume that you have already run yarn build-app.)

Thanks for the latest updates, they look good!
What I had in mind re. the “Peeling Back the Layers” slide was to explicitly appeal to your “layers” metaphor. So for the left-hand example, the top layer would be “green energy!” (expanded a bit with some actual content maybe) and the “underlying” layer (revealed with some animation) would show what in this case counts as “green energy”. This might leverage your existing idea that “behind” every surface statement/claim/visualisation are further facts that might tell a quite different story. We can discuss Friday, in the meantime I’ll try to make some progress on my parts of the talk.

@RaoOfPhysics I’m experimenting with linear navigation because I find the ergonomics of default tricky – it’s easy to get into a state where the navigation arrows have unpredictable behaviour unless you know some hidden state (i.e. “where you are” in other subsections).

Whatever you're comfortable with, @rolyp!

Jump to Slide (G) can help a bit with the linear navigation.


Conflict when deploying Contoso with VPN Gateway

Describe the bug
When deploying the full contoso ref. impl. the deploy fails with the following error
{
    "status": "Failed",
    "error": {
        "code": "DeploymentFailed",
        "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.",
        "details": [
            {
                "code": "Conflict",
                "message": "{\r\n  \"status\": \"Failed\",\r\n  \"error\": {\r\n    \"code\": \"ResourceDeploymentFailure\",\r\n    \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n    \"details\": [\r\n      {\r\n        \"code\": \"DeploymentFailed\",\r\n        \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.\",\r\n        \"details\": [\r\n          {\r\n            \"code\": \"Conflict\",\r\n            \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"Conflict\\\",\\r\\n            \\\"message\\\": \\\"{\\\\r\\\\n  \\\\\\\"status\\\\\\\": \\\\\\\"Failed\\\\\\\",\\\\r\\\\n  \\\\\\\"error\\\\\\\": {\\\\r\\\\n    \\\\\\\"code\\\\\\\": \\\\\\\"ResourceDeploymentFailure\\\\\\\",\\\\r\\\\n    \\\\\\\"message\\\\\\\": \\\\\\\"The resource operation completed with terminal provisioning state 'Failed'.\\\\\\\",\\\\r\\\\n    \\\\\\\"details\\\\\\\": [\\\\r\\\\n      {\\\\r\\\\n        \\\\\\\"code\\\\\\\": \\\\\\\"OperationFailureErrors\\\\\\\",\\\\r\\\\n        \\\\\\\"message\\\\\\\": \\\\\\\"The operation failed due to following errors: '[\\\\\\\\\\\\\\\"The operation failed due to following errors: '[\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\"The vpn gateway deployment operation failed due to an intermittent error. Please try again.\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\"]'.\\\\\\\\\\\\\\\"]'.\\\\\\\",\\\\r\\\\n        \\\\\\\"details\\\\\\\": []\\\\r\\\\n      }\\\\r\\\\n    ]\\\\r\\\\n  }\\\\r\\\\n}\\\"\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n          }\r\n        ]\r\n      }\r\n    ]\r\n  }\r\n}"
            }
        ]
    }
}

I've tried rerunning the deployment again, 10-12 hours later, with the same parameters, resulting in the same error.
If I go to the Connectivity subscription's "EntScale connectivitySub" deployment I can see that it fails on Microsoft.Network/azureFirewalls BadRequest:
{
    "status": "Failed",
    "error": {
        "code": "SimultaneousAddDeleteNotPermittedForHubIPAddress",
        "message": "Addition and deletion of Public IP addresses not permitted in a single operation for Azure Firewall /subscriptions/63dcfd64-4289-4ef8-afb7-ce97df63278d/resourceGroups/test--connectivity/providers/Microsoft.Network/azureFirewalls/test--fw-westeurope.",
        "details": []
    }
}

I can't say for sure if this exact error occurred on the first run, but I have a slight suspicion it was not.
Steps to reproduce

Deploy contoso ref. impl. with all options enabled (including VPN Gateway)

Screenshots

Thanks for reporting this. It appears to be caused by a race condition on the networking resource provider, so we will correct that with a PR.
If this is for testing purposes, I suggest using Adventure Works (traditional hub and spoke networking) for now until we have patched Contoso.

Closing this as we have corrected the issue in Contoso reference implementation. Thanks!