Resolve slowdown in database queries during production deploy

Description
We experienced a slowdown in database query performance during a production deploy. This does not appear to be related to https://github.com/CDCgov/prime-simplereport/issues/3953, which may cause similar behavior under similar scenarios.
https://skylight-hq.slack.com/archives/C01LTSNKEPP/p1658779542717329?thread_ts=1658775228.966189&cid=C01LTSNKEPP
https://skylight-hq.slack.com/archives/C01LTSNKEPP/p1659122036670229?thread_ts=1659120024.510939&cid=C01LTSNKEPP
Acceptance criteria

?

Dev approach

Look into how the way our staging slot suddenly creates new resources on deploy

Before we changed over to the flexible database, the stg slot would copy all of the prod slot's infrastructure (each version adding additional active connections)
This would tip us over our connection limit and cause issues
This shouldn't be happening now with ~5000 connections available, but this is a potential avenue of research

Maybe an issue with our CI/CD pipeline slowing down queries during deployments?

Could be running up against the limit of database connections which is then overwhelmed by the rollout

Logs indicate a very large quantity of audit-related database queries in progress at the time of the deploy

Maybe the container was killed before all of them could complete + close?

I'm upping the priority of this issue, as it was just seen during another production deployment on 8/2 (the deploy happened around 1:07PT and the slowdown occurred at 1:15PT.)

This was very difficult to investigate. The best I've been able to glean is that it happens when multiple deployments are triggered close to each other. We need more information.
My recommendation at this point is that we enable some additional tools to help future investigations.

Enable a long query log: Set the Postgres configuration with something like this log_min_duration_statement = 2000
It might be worth enabling auto_explain, which we can use to find unstable execution plans.
Enable pg_stat_statements. We can use this to find the queries that add the most load. Long-running queries are a problem, but efficient queries we run often can also add substantial load. We can use information from this to find out how much total execution time the database spends on all our queries.

@rin-skylight Would you prefer to keep going with this ticket or should I write up a new ticket to explore the recommendations I made?

From what we gathered, it seems like this error pops up when we have a third slot active, as each slot, even when receiving no traffic, spawns the requisite data connections. Deleting the extra slot (used for spring upgrades) seems to have resolved these issues.
Let's write up the other tickets, for the sake of helping future us! They can be lower-priority.


Taxi data set download

The location of the taxi dataset might be incorrect.
AttributeError: 'DataFrame' object has no attribute 'pickup_longitude'

They have moved their data to http://pugetsoundlidar.ess.washington.edu/lidardata/restricted/be_ascii/pslc2016/2016King_County_Delivery_1_bare_earth_ascii/
The page requires authorization, but after you register and login you can download all of the datasets manually to the examples/data directory - that should work.

@p-himik, I've opened a new issue #362 about that problem, which is for the Lidar dataset, not the taxi dataset.  Thanks for the tip, in any case!
@zzzrpagliari, can you clarify what is giving you that error message?  The taxi dataset we provide has a column pickup_x, which is the longitude already converted to Web Mercator coordinates.  I don't think we have any code that relies on pickup_longitude, but if we do, that's presumably an error, in which case please re-open this issue and give us an idea where that is.


Adding FAQ and Privacy Policy Pages to the URL Shortener Website [GSSOC-2023] #113

Related Issue
Adding FAQ and Privacy Policy Pages to the URL Shortener Website
Closes: #113
Description of Changes

added FAQ && PRIVACY HTML files and kept in the root directory
kept the theme and color palette the same as the homepage.
added links in the navbar homepage (index.php)
added content related to Shorty on both pages

Checklist:

[x] mobile compatible
[x] followed a similar theme as the home page
[x] added content related to the Shorty website.
[x] kept single page only
[x] files added in the root directory

Screenshots

VIDEO
https://github.com/apoorvaron/Shorty/assets/99162236/5da6232a-2bb3-4a9b-9bce-84a3fc4f1b16

sorry my previous pull request got closed due unknown reason:  https://github.com/apoorvaron/Shorty/pull/132
you have requested changes:
@Mrprayag077 Nice work but also create common files for header and footer
For "Chatbot and Scroll to top" make file inside /tiny/incudes/chatbotsidebar.php
For "Common Header" make file inside /tiny/incudes/header.php
For "Common Footer" make file inside /tiny/incudes/footer.php
I hope you understand
Thanks!
Done
i have added a includes folder in which there are three files->

chatbotsidebar.php
header.php
footer.php

Screenshot

@apoorvaron plz review the changes

@Mrprayag077 only one issue occurs that if i am on faq btn should be active (FAQ btn should be active/bolder than other)

@apoorvaron thank you. I have added the functionality just I think due to a change in URL structure it's not working
on line number 73: it's './faq.php'  and in the picture provided by you it seems to be '/faq' only so just update that and it will work.  same logic for privacy ..... '/pirvacy.php' -->  '/privacy'
UPDATED CODE: replace in header.php line number: 63

if you need i can create a new pull request

@Mrprayag077  Okay , it is now working but one more issue
if i click either Question , Two answer window opens
https://github.com/apoorvaron/Shorty/assets/83576954/5b5ed17e-864f-4ef1-b408-8780381541f6

ohhh yes thanks for noticing it.
it's due to the id miss match: I have updated the code. just will have to replace the below section in FAQ.PHP line number 83
also, to resolve the issue= on question three there was coming extra question symbol
updated code:

                                    <button class="accordion-button collapsed" type="button" data-bs-toggle="collapse"
                                        data-bs-target="#faq-content-1">

                                        How does the link shortening process work?
                                    </button>

                                        The link shortening process takes a long URL and generates a shorter, more
                                        compact URL that
                                        redirects to the original long URL. This allows for easier sharing and tracking
                                        of links.

                                    <button class="accordion-button collapsed" type="button" data-bs-toggle="collapse"
                                        data-bs-target="#faq-content-2">

                                        Do I need to create an account to use the link shortening
                                        service?
                                    </button>

                                        No, you can use the link shortening service without creating an account.
                                        However, creating an
                                        account provides additional benefits such as link management, editing options,
                                        and
                                        personalized
                                        features.

                                    <button class="accordion-button collapsed" type="button" data-bs-toggle="collapse"
                                        data-bs-target="#faq-content-3">

                                        What are the steps to shorten a link?
                                    </button>

                                        To shorten a link, follow these steps:

Go to the homepage of the link shortening website.

Locate the input field provided, where you can enter the original long
                                                URL.

Enter the long URL into the input field.

Click on the "Shorten" button or a similar button to initiate the link
                                                shortening process.

After a brief moment, a shortened link will be generated.

The shortened link will be displayed below, and you can simply copy it
                                                to your clipboard.

The shortened link is now ready to be shared or used as needed.

                                    <button class="accordion-button collapsed" type="button" data-bs-toggle="collapse"
                                        data-bs-target="#faq-content-4">

                                        Can I edit or update my profile details?
                                    </button>

                                        Yes, once you have created an account, you can access your profile settings and
                                        make changes
                                        to
                                        your personal information, such as your name, profile picture, and contact
                                        details.

                                    <button class="accordion-button collapsed" type="button" data-bs-toggle="collapse"
                                        data-bs-target="#faq-content-5">

                                        How do I manage my stored links?
                                    </button>

                                        After logging into your account, you will have access to a link management
                                        dashboard. From there,
                                        you can view, edit, delete, or organize your stored links, making it easy to
                                        manage and
                                        track your shortened URLs.

                                    <button class="accordion-button collapsed" type="button" data-bs-toggle="collapse"
                                        data-bs-target="#faq-content-6">

                                        Does it require any money?
                                    </button>

                                        Its totally free application anyone can use it.

video:
https://github.com/apoorvaron/Shorty/assets/99162236/41ba26a7-c447-44a0-96cf-e30aefad09ea

@Mrprayag077 Done 👍
ig it is completed. Now you can find another issue.
Thanks!

Thank you for your feedback. It has been a fantastic experience working on this project. I have a small request: could you please update the tag to LEVEL2, feature adding? I have dedicated a significant amount of time to this task, including the creation of new pages for FAQ and Privacy. Additionally, I have optimized the syntax by introducing an included folder. Currently, the project is labeled as LEVEL1, but I believe it deserves a higher level designation since different points are allocated based on the levels.

@Mrprayag077 Added Level3 Label


fix characters with too many deaths cause crash

fix #271

Maybe we should add some indicator that the deaths list is truncated as well..
deaths_truncated or something maybe?


Add BloomFilter union and intersection

Related to #4

[Current coverage][cc-pull] is 0.00%

Merging [#6][cc-pull] into [master][cc-base-branch] will not change coverage

@@           master   #6   diff @@
==================================
  Files          11   11
  Lines          30   30
  Methods         0    0
  Messages        0    0
  Branches        3    3
==================================
  Hits            0    0
  Misses         30   30
  Partials        0    0

Powered by Codecov. Last updated by [abe03c0...2d59d3a][cc-compare]
[cc-base-branch]: https://codecov.io/gh/alexandrnikitin/bloom-filter-scala/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/alexandrnikitin/bloom-filter-scala/compare/abe03c0741369e2dabe1b8938871b6aa51d60352...2d59d3a8b4e47f3e8349d1b782c7aa6a858be1b5?src=pr
[cc-pull]: https://codecov.io/gh/alexandrnikitin/bloom-filter-scala/pull/6?src=pr

:+1: Great! Merging it. Thank you!


Remove unused Data::Dumper from cmake exporter

Remove possible additional  requiremet for old build boxes (in particular centos)
Similar to issue https://github.com/openssl/openssl/issues/19546

General question, given that our CI doesn't use the cmake files at all, I'd like to hand build using cmake in reviewing these and future bugs, but I don't see any specific notes on the use of cmake in the openssl build environment, and the standard cmake -S . B command misses the CMakeFiles.txt output, even after generating the cmake files. Can you point me to instructions on how to use these files?

We also generate pkg-config files, equally untested by us.  It would probably be fairly trivial to add such tests, at least for the buildtree-specific files.


conform.py bug

Description
The conform.py has a bug, which will impact behavior whenever the parameter f_low is not zero. Fortunately, zero is the default for f_low. Fixing this would allow sophisticated usage and development.
The issue is that src_min is initially set to the global minimum. However, f_low is subsequently updated to the lower output threshold. The problem is that final computation of the output high threshold (src_max) assumes the value of src_min is still the global minimum:
    src_min = idx * bin_size + src_min

    # get upper limit
    nth = voxnum - int((1.0 - f_high) * nz)
    idx = np.where(cs >= nth)

    if len(idx[0]) > 0:
        idx = idx[0][0] - 2

    else:
        print("ERROR: rescale upper bound not found")

    src_max = idx * bin_size + src_min

An easy fix would be to explicitly create and refer to a global_min variable that is independent from the output minimum:
    global_min = src_min
    src_min = idx * bin_size + global_min

    # get upper limit
    nth = voxnum - int((1.0 - f_high) * nz)
    idx = np.where(cs >= nth)

    if len(idx[0]) > 0:
        idx = idx[0][0] - 2

    else:
        print("ERROR: rescale upper bound not found")

    src_max = idx * bin_size + global_min

I think I have just confirmed the existence of this bug. When we fix this, we might as well make the math easier to understand though.

This has been fixed by #506.


Retweets

Is there a way to exclude retweets from the full_archive_search?

Yes there is a simple way to exclude retweets in queries.

Thanks for the answer! Could you maybe use it in an example with the search_full_archive() function? It would really help a lot. Btw, you did a great job on the package.

Sure:

Sure an easy example would be something like this:
`
library(RTwitterV2)
To exclude retweets just add -is:retweet to the query itself:
query <- "#Biden OR #Trump -is:retweet"
lower <- "2020-06-01T00:00:01Z"
upper <- "2021-06-01T00:00:01Z"
tmp <- full_archive_search(token = Bearer_Token, search_query = query, n = 2500,
start_time=lower, end_time=upper, JSON = FALSE)
unique(tmp$is_retweet)
`


Add link to HOWTO guide in README

Add link to HOWTO guides
Add links to some core optimizers/layers
Add an FAQ section

Codecov Report

Merging #324 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #324   +/-   ##
=======================================
  Coverage   79.32%   79.32%
=======================================
  Files          34       34
  Lines        2254     2254
=======================================
  Hits         1788     1788
  Misses        466      466

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 484cc11...0ba6448. Read the comment docs.

Hi, @Bharat123rox this PR has been inactive for a while, do you still intent to update it?

Hi @jheek I'm still working on it, sorry for not committing here

Codecov Report

Merging #324 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #324   +/-   ##
=======================================
  Coverage   80.09%   80.09%
=======================================
  Files          55       55
  Lines        4009     4009
=======================================
  Hits         3211     3211
  Misses        798      798

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 717d504...f63c37a. Read the comment docs.


Introduce Retry Support for Spring Cloud LoadBalancer - reactive

As discussed here.

Consider storing service ids in RequestContext. Also see:  https://github.com/spring-cloud/spring-cloud-commons/issues/747.

applaud. Hope to view this enhancement ASAP

public interface LoadBalancedRetryFactory {
/**
 * Creates a {@link LoadBalancedRetryPolicy}.
 * @param service The ID of the service to create the retry policy for.
 * @param serviceInstanceChooser Used to get the next server from a load balancer.
 * @return A retry policy for the service.
 */
default LoadBalancedRetryPolicy createRetryPolicy(String service,
		ServiceInstanceChooser serviceInstanceChooser) {
	return null;
}

May I know when will the LoadBalancedRetryPolicy will have the implement ? we are eager to for this. Currently, it will never retry to find another available server instance.
@OlgaMaciaszek


Bump go-md2man to 1.0.3

Fixes an issue with curly braces being escaped when they should not be.
This was particularly an issue in places where --format '{{ ...  }}'
is used in the man docs.

ping @tianon

LGTM :+1:

LGTM


Verify the signature of a webhook

This project should be deprecated and added into the examples folder.
https://github.com/moovfinancial/webhook-handler

Added in #98

Can we close this issue now?

Looks solved to me. @vxio ?

All of this is in a feature branch, https://github.com/moovfinancial/moov-go/tree/feat-webhooks; I'll close this issue once we merge that feature branch to main

Handled in https://github.com/moovfinancial/moov-go/pull/112


Swift 3: configure support for extended test suite

Add a configure argument to enable extended test suite.
The extended test suite is disabled by default (and thus
will not be run in vanilla Swift CI jobs).
Move yet another intermittently failing test,
dispatch_suspend_timer, out of the list of default tests.

@erg Swift3 branch version of #187


Fake News detector

Aim
The aim of the project would be to predict if the news is real or fake.
Details

I'd be using passive aggressive classifier for the model and the dataset that I will be using for training is: https://drive.google.com/file/d/1er9NJTLUA3qnRuyhfzuN0XUsoIC4a-_q/view

@kaustubhgupta The folder structure will be like this:
Dataset folder->csv file
fakenewsdetection.py
README
I'll start with the structure this way,if there are any edits or changes,I'll update ,is that okay?

Okay cool!

Hey,unfortunately I have a health emergency in my family to deal with.I would still like to contribute but I might not be able to make a pr before the 20th.If this is an urgent work,you can unassign me,sorry for the inconvenience from my side.

Hey,unfortunately I have a health emergency in my family to deal with.I would still like to contribute but I m

Hey, It's not urgent work, you should look after your family first. If you feel like contributing, try to contribute max by 27-28 May so that your PR is well-reviewed and merged before the program ends. Hope your family member recovers soon!

Sorry but as the program is about to end, I have to close this issue.


[Bug] mvc-annotation-commons NoSuchMethodError ServerHttpRequest.getMethodValue()

Search before asking

[X] I had searched in the issues and found no similar issues.

Apache SkyWalking Component
Java Agent (apache/skywalking-java)
What happened
Run a project with

SpringBoot 3.2.0(released at 2023.11.03)
apm-springmvc-annotation-commons-9.1.0.jar
apm-springmvc-annotation-6.x-plugin-9.1.0.jar

can not trace SpringMVC node because of the error from java-agent logs
java.lang.NoSuchMethodError: 'java.lang.String org.springframework.http.server.reactive.ServerHttpRequest.getMethodValue()'
	at org.apache.skywalking.apm.plugin.spring.mvc.commons.interceptor.AbstractMethodInterceptor.beforeMethod(AbstractMethodInterceptor.java:171)
	at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:76)

but works fine with SpringBoot previous version, like 3.1.0.
With the error and the source code, see that:
public interface HttpRequest extends HttpMessage {
......
	@Deprecated(since = "6.0", forRemoval = true)
	default String getMethodValue() {
		return getMethod().name();
	}
......
}

the method getMethodValue removed from SpringBoot 3.2.0
What you expected to happen
SpringMVC node can be traced  with SpringBoot 3.1.0, and can not traced with SpringBoot 3.2.0.
We should fix the bug.
How to reproduce
Run a normal SpingBoot project with

SpringBoot 3.2.0(released at 2023.11.03)
apm-springmvc-annotation-commons-9.1.0.jar
apm-springmvc-annotation-6.x-plugin-9.1.0.jar

Anything else
No response
Are you willing to submit a pull request to fix on your own?

[X] Yes I am willing to submit a pull request on my own!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Are you proposing a new interceptor for newer version?

Are you proposing a new interceptor for newer version?

add the witnessmethod and add a new interceptor.

That works. And please make sure you add the new unsupported version into the test matrix.

That works. And please make sure you add the new unsupported version into the test matrix.

Got it.

I have checked gettMethod && getMethodValue method called by org.springframework.http.server.reactive.ServerHttpRequest in all spring-web versions（3.0.x/3.1.x/3.2.x/4.0.x/4.1.x/4.2.x/4.3.x/5.0.x/5.1.x/5.2.x/5.3.x/6.0.x/6.1.x），getMethod exists all the time, but getMethodValue only in version 5.x & 6.0.x
Whether we can just change the method from getMethodValue to getMehtod without a new interceptor?
3.0.x
/**
 * Represents a server-side HTTP request.
 *
 * @author Arjen Poutsma
 * @since 3.0
 */
public interface ServerHttpRequest extends HttpInputMessage {

	/**
	 * Return the HTTP method of the request.
	 * @return the HTTP method as an HttpMethod enum value
	 */
	HttpMethod getMethod();

	/**
	 * Return the URI of the request.
	 * @return the URI of the request
	 */
	URI getURI();
}

3.1.x/3.2.x
public interface ServerHttpRequest extends HttpRequest, HttpInputMessage {

}

/**
 * Represents an HTTP request message, consisting of {@linkplain #getMethod() method}
 * and {@linkplain #getURI() uri}.
 *
 * @author Arjen Poutsma
 * @since 3.1
 */
public interface HttpRequest extends HttpMessage {

	/**
	 * Return the HTTP method of the request.
	 * @return the HTTP method as an HttpMethod enum value
	 */
	HttpMethod getMethod();

	/**
	 * Return the URI of the request.
	 * @return the URI of the request
	 */
	URI getURI();

}

4.0.x/4.1.x/4.2.x/4.3.x
/**
 * Represents a server-side HTTP request.
 *
 * @author Arjen Poutsma
 * @author Rossen Stoyanchev
 * @since 3.0
 */
public interface ServerHttpRequest extends HttpRequest, HttpInputMessage {

	/**
	 * Return a {@link java.security.Principal} instance containing the name of the
	 * authenticated user. If the user has not been authenticated, the method returns
	 * null.
	 */
	Principal getPrincipal();

	/**
	 * Return the address on which the request was received.
	 */
	InetSocketAddress getLocalAddress();

	/**
	 * Return the address of the remote client.
	 */
	InetSocketAddress getRemoteAddress();

	/**
	 * Return a control that allows putting the request in asynchronous mode so the
	 * response remains open until closed explicitly from the current or another thread.
	 */
	ServerHttpAsyncRequestControl getAsyncRequestControl(ServerHttpResponse response);

}

/**
 * Represents an HTTP request message, consisting of {@linkplain #getMethod() method}
 * and {@linkplain #getURI() uri}.
 *
 * @author Arjen Poutsma
 * @since 3.1
 */
public interface HttpRequest extends HttpMessage {

	/**
	 * Return the HTTP method of the request.
	 * @return the HTTP method as an HttpMethod enum value
	 */
	HttpMethod getMethod();

	/**
	 * Return the URI of the request.
	 * @return the URI of the request
	 */
	URI getURI();

}

5.0.x/5.1.x/5.2.x/5.3.x
/**
 * Represents a server-side HTTP request.
 *
 * @author Arjen Poutsma
 * @author Rossen Stoyanchev
 * @since 3.0
 */
public interface ServerHttpRequest extends HttpRequest, HttpInputMessage {

	/**
	 * Return a {@link java.security.Principal} instance containing the name of the
	 * authenticated user.
	 *
If the user has not been authenticated, the method returns null.
	 */
	@Nullable
	Principal getPrincipal();

	/**
	 * Return the address on which the request was received.
	 */
	InetSocketAddress getLocalAddress();

	/**
	 * Return the address of the remote client.
	 */
	InetSocketAddress getRemoteAddress();

	/**
	 * Return a control that allows putting the request in asynchronous mode so the
	 * response remains open until closed explicitly from the current or another thread.
	 */
	ServerHttpAsyncRequestControl getAsyncRequestControl(ServerHttpResponse response);

}
/**
 * Represents an HTTP request message, consisting of
 * {@linkplain #getMethod() method} and {@linkplain #getURI() uri}.
 *
 * @author Arjen Poutsma
 * @since 3.1
 */
public interface HttpRequest extends HttpMessage {

	/**
	 * Return the HTTP method of the request.
	 * @return the HTTP method as an HttpMethod enum value, or {@code null}
	 * if not resolvable (e.g. in case of a non-standard HTTP method)
	 * @see #getMethodValue()
	 * @see HttpMethod#resolve(String)
	 */
	@Nullable
	default HttpMethod getMethod() {
		return HttpMethod.resolve(getMethodValue());
	}

	/**
	 * Return the HTTP method of the request as a String value.
	 * @return the HTTP method as a plain String
	 * @since 5.0
	 * @see #getMethod()
	 */
	String getMethodValue();

	/**
	 * Return the URI of the request (including a query string if any,
	 * but only if it is well-formed for a URI representation).
	 * @return the URI of the request (never {@code null})
	 */
	URI getURI();

}

6.0.x
/**
 * Represents a server-side HTTP request.
 *
 * @author Arjen Poutsma
 * @author Rossen Stoyanchev
 * @since 3.0
 */
public interface ServerHttpRequest extends HttpRequest, HttpInputMessage {

	/**
	 * Return a {@link java.security.Principal} instance containing the name of the
	 * authenticated user.
	 *
If the user has not been authenticated, the method returns null.
	 */
	@Nullable
	Principal getPrincipal();

	/**
	 * Return the address on which the request was received.
	 */
	InetSocketAddress getLocalAddress();

	/**
	 * Return the address of the remote client.
	 */
	InetSocketAddress getRemoteAddress();

	/**
	 * Return a control that allows putting the request in asynchronous mode so the
	 * response remains open until closed explicitly from the current or another thread.
	 */
	ServerHttpAsyncRequestControl getAsyncRequestControl(ServerHttpResponse response);

}

/**
 * Represents an HTTP request message, consisting of a
 * {@linkplain #getMethod() method} and a {@linkplain #getURI() URI}.
 *
 * @author Arjen Poutsma
 * @since 3.1
 */
public interface HttpRequest extends HttpMessage {

	/**
	 * Return the HTTP method of the request.
	 * @return the HTTP method as an HttpMethod value
	 * @see HttpMethod#valueOf(String)
	 */
	HttpMethod getMethod();

	/**
	 * Return the HTTP method of the request as a String value.
	 * @return the HTTP method as a plain String
	 * @since 5.0
	 * @see #getMethod()
	 * @deprecated as of Spring Framework 6.0 in favor of {@link #getMethod()} and
	 * {@link HttpMethod#name()}
	 */
	@Deprecated(since = "6.0", forRemoval = true)
	default String getMethodValue() {
		return getMethod().name();
	}

	/**
	 * Return the URI of the request (including a query string if any,
	 * but only if it is well-formed for a URI representation).
	 * @return the URI of the request (never {@code null})
	 */
	URI getURI();

}

6.1.x
/**
 * Represents a server-side HTTP request.
 *
 * @author Arjen Poutsma
 * @author Rossen Stoyanchev
 * @since 3.0
 */
public interface ServerHttpRequest extends HttpRequest, HttpInputMessage {

	/**
	 * Return a {@link java.security.Principal} instance containing the name of the
	 * authenticated user.
	 *
If the user has not been authenticated, the method returns null.
	 */
	@Nullable
	Principal getPrincipal();

	/**
	 * Return the address on which the request was received.
	 */
	InetSocketAddress getLocalAddress();

	/**
	 * Return the address of the remote client.
	 */
	InetSocketAddress getRemoteAddress();

	/**
	 * Return a control that allows putting the request in asynchronous mode so the
	 * response remains open until closed explicitly from the current or another thread.
	 */
	ServerHttpAsyncRequestControl getAsyncRequestControl(ServerHttpResponse response);

}

/**
 * Represents an HTTP request message, consisting of a
 * {@linkplain #getMethod() method} and a {@linkplain #getURI() URI}.
 *
 * @author Arjen Poutsma
 * @since 3.1
 */
public interface HttpRequest extends HttpMessage {

	/**
	 * Return the HTTP method of the request.
	 * @return the HTTP method as an HttpMethod value
	 * @see HttpMethod#valueOf(String)
	 */
	HttpMethod getMethod();

	/**
	 * Return the URI of the request (including a query string if any,
	 * but only if it is well-formed for a URI representation).
	 * @return the URI of the request (never {@code null})
	 */
	URI getURI();

}

In the Spring 6, getMethodValue is deprecated but because Deprecated as of Spring Framework 6.0 in favor of getMethod() and HttpMethod.name().
You could try whether your solution works.


Expose chunksize in Dask Array API

Frequently am finding myself in situations where I need to create another array say to multiply to some Dask Array provided as input. In these situations, the new array needs some chunk size provided. As there is really no reason to pick the new array's chunksize to be anything other than that of the input array, I'd really like a simple way to do that. However, FWICT there isn't one. The best one can do is roll their own version of this, which merely gets the first chunk for each dimension. At a bare minimum, it would be nice if that was a readonly attribute (property) of Dask Array's for these use cases.

Frequently am finding myself in situations where I need to create another array say to multiply to some Dask Array provided as input. In these situations, the new array needs some chunk size provided.

Do you mean you want to create an array with the same chunks as the input to do some operation on where the chunks should align? In this case chunksize wouldn't be sufficient, as dask arrays don't need to have all chunks be identically shaped. Is there a reason you can't just use the chunks attribute as is? Any method that takes chunks as a parameter should work fine with an existing chunks tuple. E.g.
a = some_dask_array
ones = da.ones(a.shape, chunks=a.chunks)   # same chunks as `a`

Yeah I end up needing to feed it into linspace or arange or similar, which acts on a single dimension. Seem to be running into issues when I do that.

Seems to work fine for me? Note that your input chunks must match the expected shape:
In [1]: import dask.array as da

In [2]: da.arange(10, chunks=(4, 4, 2)).compute().shape
Out[2]: (10,)

In [3]: da.linspace(0, 1, 10, chunks=(4, 4, 2)).compute().shape
Out[3]: (10,)

In [4]: da.arange(10, chunks=(4, 4, 1)) # bad chunks
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-4-b896e65e4ac3> in <module>()
----> 1 da.arange(10, chunks=(4, 4, 1)) # bad chunks

/Users/jcrist/Code/dask/dask/array/creation.py in arange(*args, **kwargs)
    124
    125     num = max(np.ceil((stop - start) / step), 0)
--> 126     chunks = normalize_chunks(chunks, (num,))
    127
    128     name = 'arange-' + tokenize((start, stop, step, chunks, num))

/Users/jcrist/Code/dask/dask/array/core.py in normalize_chunks(chunks, shape)
   1803             raise ValueError(
   1804                 "Chunks and shape must be of the same length/dimension. "
-> 1805                 "Got chunks=%s, shape=%s" % (chunks, shape))
   1806
   1807     if shape is not None:

ValueError: Chunks and shape must be of the same length/dimension. Got chunks=(4, 4, 1), shape=(10.0,)

Note that the .chunks attribute is a tuple of tuples. Since linspace and arange only return 1d arrays, you need to subselect along a dimension to align. Something like:
a = some_dask_array
aligned_on_zeroth_axis = da.linspace(a.shape[0], chunks=a.chunks[0])

It's a little more subtle than my last comment suggests it is. When using fftfreq, we create an array with linspace. However, that always contains one more value than we care about (namely the last value). So if the chunks are anything other than a number, they will likely not add to the full length. I think this could be fixed if we normalize the given chunks first and add a singleton chunk for the end (as it will be removed anyways). Thoughts?

That would work. The relevant function is dask.array.core.normalize_chunks.
Looking at that function more it's not clear what a fully specified chunks (e.g. a tuple) argument means for rfftfreq, since it doesn't return the full size. You could separate the call to linspace between real and imaginary and be smart about creating the output exactly with the specified chunks, but I'm not sure if it's worth it.

Cool, I think PR ( https://github.com/dask/dask/pull/2330 ) will fix it then.

Thoughts on what chunks means for rfftfreq?

Updated the aforementioned PR to handle that case as well.

Fixed by #2330. Closing.

FWIW I still think this is an interesting idea, but yes the motivating use case has been resolved in a better way.

My issue with that is chunksize isn't a good measure of chunks unless all chunks have the same shape. Since we expose chunks as an attribute already (which is a good measure), I'm hesitant to expose chunksize as I think it'll be confusing and misunderstood by users more often than it'll be useful.

Maybe having upper and lower bounds on it would be good?


Modifier not showing Color Codes in messages

When you use a level down modifier it shows a gigantic message for unidentified color codes.
I am unsure if it is like so for the other modifiers.

This should now be fixed as of today, closing.


add active and usageLimit fields in coupon2

active:
  type: boolean
usageLimit:
  type: integer

usageLimit is already in dynamodb but it's not in the schema

done, will post a pic later


BLE Scan buggy after esp_bt_controller_disable

Hi guys,
My ESP32 has a 7 second light sleep between scanning.
The first scan is working normally, I receive up to  40 messages in my custom GAP Event Handler. Everything is fine.
After the scan I disable bluetooth using esp_bt_controller_disable() and switch to light sleep with esp_light_sleep_start()
I dont't get any errors.
After wakeup I call esp_bt_controller_enable(ESP_BT_MODE_BLE), I clean the scan results with scan->clearResults()  and start scanning again.
However, after this I only receive 3-4 broadcasts in the scan. Normally it should be something like 40 messages.
Does anyone have an idea what could be the issue?
I also tried BLEDevice::init() after the wakeup. Same results.

This is my loop:
void loop()
{
  Serial.println(" -------BEGIN SCAN---------- ");
  pScan->start(7);
  Serial.println(" -------END SCAN---------- ");

  delay(500);

  sleepFunc(6);

  wakeupHelper();
}

This is my sleep Function:
void sleepFunc(uint8_t timeInSeconds) {

  Serial.println(" -------BEGIN SLEEP---------- ");

  Serial.println(">>all wakeup sources disabled \n");
  esp_sleep_disable_wakeup_source(ESP_SLEEP_WAKEUP_ALL);

  Serial.println(">>Wake up time set");
  esp_sleep_enable_timer_wakeup(timeInSeconds * 1000000);

  Serial.print(">> bluetooth and wifi off: ");
  Serial.println(esp_bt_controller_disable());

  Serial.print(">> entering light sleep mode ");
  Serial.flush();

  if(esp_light_sleep_start() != ESP_OK)
    Serial.println(">>> Error");

  Serial.println(" -------END SLEEP---------- ");
}

My wakeup Function:
void wakeupHelper() {
  Serial.println(" -------BEGIN WAKEUP---------- ");

  Serial.print(" bluetooth  turned on: ");
  Serial.println(esp_bt_controller_enable(ESP_BT_MODE_BLE));

  Serial.println(" -------END WAKEUP---------- ");
}

My output:
https://pastebin.com/ibvfFTBQ
R is shortcut for received a broadcast in the custom GAP Handler


fix(provider): read TS Lint indent size

The TS Lint indent rule can specify the indentation size:
"indent": [true, "spaces"]

"indent": [true, "spaces", 4]

"indent": [true, "tabs", 2]

This patch allows tsfmt to read that size and correctly set the formatting options. This means that tslint and tsfmt do not fight over the indentation size.

@vvakame not sure if that error is a result of this patch?

@vvakame any chance you could have a look at this? Would be a really good quality of life improvement for the project; means that with a tslint.json there is zero need for a tsfmt.json if there is a change in indent specified.
I'm not sure why console is being defined globally twice on the CI.


No Limits on API Input Can Lead to Performance Impacts and a Bad GUI Experience

Currently if you call functions such as show_graph_report("Custom Graph", graph), you can change the variable argument, in this case "Custom Graph" to a string of arbitrary length. This will cause Binary Ninja to spike in CPU usage to about 20% on a Windows host and in the worst of cases will cause Binary Ninja to hang with "Not Responding" temporarily, which will give a bad user experience. However once it sorts itself out, it will still accept the string as valid input. I don't see any reason why such titles should have arbitrary lengths; would it perhaps be possible to limit the lengths of such input to prevent potential performance hits?
I realize that this issue is probably pretty low down on the list of priorities at the moment but I thought I'd just point it out.

As a PoC one can try the following which will result in a Custom Graph being displayed but the user not being able to interact with it cause the line input is so ridiculously long that Binary Ninja just gives up:
>>> graph = FlowGraph()
>>> node_a = FlowGraphNode(graph)
>>> node_a.lines = ["A"*900000000]
>>> graph.append(node_a)
0
>>> show_graph_report("Custom Graph", graph)

This is not a bug, merely expected behavior. We intentionally do not limit APIs such as this because it's impossible to predict what is an appropriate upper limit for specific hardware or needs and this is up to each user of the API to make the choice as to what limits they feel are appropriate.


Output stream redirect support

Fixes https://github.com/helidon-io/helidon/issues/6992

Follow up https://github.com/helidon-io/helidon/issues/7371


[AutoPR cosmos-db/resource-manager] Adding cassandra connector properties for cosmos db C* account -

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/6550

(message created by the CI based on PR content)

This PR has been merged into https://github.com/Azure/azure-sdk-for-python/pull/5933


DOCS-12647 update ingress page

@vli63127 Was there anything else needed on this other removing reference to public endpoint? Note that "public endpoint" is also in the UI/screenshot

LGTM


mask-image: stopped working after upgrading "5.2.1" to "6.1.0"

Environment
node: v18.13.0
nmp: 8.5.5
styled-components: 6.1.0
Reproduction
It works on "5.2.1" but not on "6.1.0"
Steps to reproduce
Try to apply mask-image with svg string.
.mask {
  mask-image: url("data:image/svg+xml,%3Csvg width='24' height='16' viewBox='0 0 24 16' fill='none' xmlns='http://www.w3.org/2000/svg'%3E%3Cpath fill-rule='evenodd' clip-rule='evenodd' d='M12 12C18.6274 12 24 6.62742 24 0V16H0V0C0 6.62742 5.37258 12 12 12Z' fill='white'/%3E%3C/svg%3E%0A");
}

Expected Behavior
Mask is working
Actual Behavior
Mask is not working

@irvin93d , Yep, that worked!
Thank you.


Can you use this code with periodic notes?

I would like to be able to use this code with periodic notes. Is there a way to do that? Also, can you use a hashtag instead of the folder to get your daily notes. Thanks

I haven't used periodic notes before, but I think my reply here might point you in the right direction.

can you use a hashtag instead of the folder to get your daily notes

Sorry, not sure what you mean by this. Can you explain more?


求教为什么ai回答不出问题

求教为什么ai回答不出问题

Applying quantization to glm layers
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/gradio/routes.py", line 289, in run_predict
output = await app.blocks.process_api(
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 990, in process_api
result = await self.call_function(fn_index, inputs, iterator)
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 832, in call_function
prediction = await anyio.to_thread.run_sync(
File "/usr/local/lib/python3.8/dist-packages/anyio/to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 867, in run
result = context.run(func, *args)
File "app.py", line 215, in predict
resp = knowladge_based_chat_llm.get_knowledge_based_answer(
File "app.py", line 127, in get_knowledge_based_answer
vector_store = FAISS.load_local('faiss_index', self.embeddings)
File "/usr/local/lib/python3.8/dist-packages/langchain/vectorstores/faiss.py", line 449, in load_local
index = faiss.read_index(
File "/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss_avx2.py", line 10206, in read_index
return _swigfaiss_avx2.read_index(args)
RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char) at /project/faiss/faiss/impl/io.cpp:67: Error: 'f' failed: could not open faiss_index/index.faiss for reading: No such file or directory
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']

This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No compiled kernel found.
Compiling kernels : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c
Compiling gcc -O3 -fPIC -pthread -fopenmp -std=c99 /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c -shared -o /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Kernels compiled : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Load kernel : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Setting CPU quantization kernel threads to 48
Using quantization cache
Applying quantization to glm layers
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/gradio/routes.py", line 289, in run_predict
output = await app.blocks.process_api(
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 990, in process_api
result = await self.call_function(fn_index, inputs, iterator)
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 832, in call_function
prediction = await anyio.to_thread.run_sync(
File "/usr/local/lib/python3.8/dist-packages/anyio/to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 867, in run
result = context.run(func, *args)
File "app.py", line 215, in predict
resp = knowladge_based_chat_llm.get_knowledge_based_answer(
File "app.py", line 127, in get_knowledge_based_answer
vector_store = FAISS.load_local('faiss_index', self.embeddings)
File "/usr/local/lib/python3.8/dist-packages/langchain/vectorstores/faiss.py", line 449, in load_local
index = faiss.read_index(
File "/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss_avx2.py", line 10206, in read_index
return _swigfaiss_avx2.read_index(args)
RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char) at /project/faiss/faiss/impl/io.cpp:67: Error: 'f' failed: could not open faiss_index/index.faiss for reading: No such file or directory
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No compiled kernel found.
Compiling kernels : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c
Compiling gcc -O3 -fPIC -pthread -fopenmp -std=c99 /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c -shared -o /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Kernels compiled : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Load kernel : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Setting CPU quantization kernel threads to 48
Using quantization cache
Applying quantization to glm layers
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/gradio/routes.py", line 289, in run_predict
output = await app.blocks.process_api(
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 990, in process_api
result = await self.call_function(fn_index, inputs, iterator)
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 832, in call_function
prediction = await anyio.to_thread.run_sync(
File "/usr/local/lib/python3.8/dist-packages/anyio/to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 867, in run
result = context.run(func, *args)
File "app.py", line 189, in reinit_model
return history + [[None, model_status]]
TypeError: can only concatenate str (not "list") to str
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No compiled kernel found.
Compiling kernels : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c
Compiling gcc -O3 -fPIC -pthread -fopenmp -std=c99 /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c -shared -o /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Kernels compiled : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Load kernel : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Setting CPU quantization kernel threads to 48
Using quantization cache
Applying quantization to glm layers
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/gradio/routes.py", line 289, in run_predict
output = await app.blocks.process_api(
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 990, in process_api
result = await self.call_function(fn_index, inputs, iterator)
File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 832, in call_function
prediction = await anyio.to_thread.run_sync(
File "/usr/local/lib/python3.8/dist-packages/anyio/to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 867, in run
result = context.run(func, *args)
File "app.py", line 215, in predict
resp = knowladge_based_chat_llm.get_knowledge_based_answer(
File "app.py", line 127, in get_knowledge_based_answer
vector_store = FAISS.load_local('faiss_index', self.embeddings)
File "/usr/local/lib/python3.8/dist-packages/langchain/vectorstores/faiss.py", line 449, in load_local
index = faiss.read_index(
File "/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss_avx2.py", line 10206, in read_index
return _swigfaiss_avx2.read_index(args)
RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char) at /project/faiss/faiss/impl/io.cpp:67: Error: 'f' failed: could not open faiss_index/index.faiss for reading: No such file or directory
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No compiled kernel found.
Compiling kernels : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c
Compiling gcc -O3 -fPIC -pthread -fopenmp -std=c99 /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c -shared -o /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Kernels compiled : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Load kernel : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Setting CPU quantization kernel threads to 48
Using quantization cache
Applying quantization to glm layers
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py:1383: UserWarning: positional arguments and argument "destination" are deprecated. nn.Module.state_dict will not accept them in the future. Refer to https://pytorch.org/docs/master/generated/torch.nn.Module.html#torch.nn.Module.state_dict for details.
warnings.warn(
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No sentence-transformers model found with name /dataset/ernie-3.0-base-zh. Creating a new one with MEAN pooling.
Some weights of the model checkpoint at /dataset/ernie-3.0-base-zh were not used when initializing ErnieModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias']
This IS expected if you are initializing ErnieModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing ErnieModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
No compiled kernel found.
Compiling kernels : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c
Compiling gcc -O3 -fPIC -pthread -fopenmp -std=c99 /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.c -shared -o /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Kernels compiled : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Load kernel : /root/.cache/huggingface/modules/transformers_modules/chatglm-6b-int4/quantization_kernels_parallel.so
Setting CPU quantization kernel threads to 48
Using quantization cache
Applying quantization to glm layers
The dtype of attention mask (torch.int64) is not bool
编程小白，求教大佬我的设置有什么问题吗

换一个embedding model看是否可以。


No More Bartender Incendiaries on Meta

About the PR

Removed incendiary rounds from the bartender's room on Meta.
Why / Balance

There is no reason bartender's should have access to extra-deadly lethal shells on roundstart.
Technical details

Media

[X] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes

Changelog

:cl: Aexxie
ADMIN:

remove: Removed the bartender's roundstart incendiary shells on Meta.

it was fun while it lasted, valid change

No reason? Beanbags no longer work so bartender clearly needs something so those bastards know they mean bussiness!


WOQL.js: WOQL.and returns false

It should give an empty result instead when running Woql.and().

Not sure that this is a bug as such - I think it's always an error in query construction


adds agrocd integration dockerfile, scripts, doc  and examples

Added DockerFile for argocd container which will be used from presynchook which will connect to terrascan admission controller webhook.
Added readme file for all the integration steps.
Added Example folder which has template for presynchook yaml.

all the other requested changes can be addressed in follow-up PRs. this is good. enough to merge


Fix for issue #12940: Wrong country borders in example

Issue #12940
Fixed country names:'Swaziland' to 'Eswatini', 'Macedonia' to 'North Macedonia'.
Removed 'North Cyprus' and a wrong border line within 'Cyprus'.
Sources:
All: https://www.un.org/en/about-us/member-states
Eswatini: https://en.wikipedia.org/wiki/Eswatini
North Macedonia: https://en.wikipedia.org/wiki/North_Macedonia
Cyprus: https://en.wikipedia.org/wiki/Cyprus

Thanks for your work on this PR and opening the issue, @dzach
The countries.geojson file is base on data from https://github.com/nvkelso/natural-earth-vector. The name changes you suggest are already included in the latest commit there. I opened #12942 to have these changes included in OpenLayers.
North Cyprus is still a separate country in this version, but I would prefer you take this issue to https://github.com/nvkelso/natural-earth-vector because changing the data manually will make it harder to update in the future.
Here is a comment thread on why the data is like this https://github.com/nvkelso/natural-earth-vector/issues/391#issuecomment-672085221

@MoonE : Thank you for reviewing this PR and for pointing to the https://github.com/nvkelso/natural-earth-vector/issues/391#issuecomment-678230303 thread.
As I read in that thread, if I get it correctly, changing the data maually in OL will be necessary, since that project will offer 'worldviews' for users to decide what to use from their dataset. Hence the issue may anavoidably become politicized.
Therefore it all falls back to OL, and what principle to apply in situations like this. If the non internationally recognized 'Northern Cyprus' remains in the dataset, it would be an indication of good faith to provide a reason why.
Please see my long reply in https://github.com/openlayers/openlayers/issues/12940#issuecomment-955683848


fix bug if there is a "-" in schame

当数据库或者表名中存在 “-”符号时，会存在找不到db或者table的问题

Btw, can you help me add a test case too?

Hi @lkpjj
I have already fixed the issued now, Thank you very much.


refactored code to increase reuse of the date formatting code

Have refactored the code to allow for the reuse of the method
Related to #1718

Thank you!


Can I return an array of elements?

I get:
JSX element type 'Element[]' is not a constructor function for JSX elements.

I remember that React should have supported an array of elements.

You want to return a couple of components with no parent? I do that with fragments.
return <>
{boxes.map(...)}
</>

Okay, seems it's a feature of React dom reconsiller? https://alligator.io/react/rendering-arrays-in-react/

You can return fragments, but babel and TS have to be up to date. here's an example that uses it: https://codesandbox.io/s/three-fibre-userender-test-fojbq

Good to know is that if your dev environment is not of the latest (like drcmda mentioned) you can instead use <Fragment></Fragment> from React. This also allows you to use the key prop if needed.


.maimap: update Akihiro Suda's email address

No affiliation change (NTT).
The former email address will continue to be available for the time being.
For daily communication, I still prefer to use my gmail.com address.
Signed-off-by: Akihiro Suda<EMAIL_ADDRESS>

LGTM


Chocolatey GUI will crash / cred from source

What You Are Seeing?
The video seemes to be glitched ton the start. I just opened Chocolateey GUI normaly.
https://user-images.githubusercontent.com/52313983/154329787-b476cf8c-abee-458b-9442-3f7373e02529.mp4
After doed this 2 times, one by error and the second to reproduce the bug, I has a error screen, than now I desactivate the source, need to try 3 more times before working... RNG ?
What is Expected?
To not crash and tell to the user there is no creds for this source
How Did You Get This To Happen? (Steps to Reproduce)
https://user-images.githubusercontent.com/52313983/154329787-b476cf8c-abee-458b-9442-3f7373e02529.mp4
System Details

OS Build: 10.0.19044.0
Windows PowerShell version: 7.2.1
Chocolatey version: v0.12.1

Output Log

Search in logfile "======= Where I added the broken source =======" to go quickly to the bug
chocolateyShrinked.log
If you really want the non shrinked version, I can send it.

🆙


By default, it seems that learnable parameters are still added to the vision encoder?

As shown in the figure, the trainable parameters of the model are printed as follows.

Did I make a mistake somewhere?

Thanks for reporting this. Could you paste the exact bash commands for launching the training so that we can reproduce and dig into it?

NUM_GPUS=1
DISTRIBUTED_ARGS="
--nnodes=1
--nproc_per_node ${NUM_GPUS}
--rdzv_backend c10d
--rdzv_endpoint localhost:4
"
arguments that are very likely to be changed
according to your own case
MODEL_ID=llava-interleave-qwen-0.5b                               # model id; pick on by running python supported_models.py
TRAIN_DATA_PATH=./example_data/celeba_image_train.json  # path to the training data json file
EVAL_DATA_PATH=./example_data/celeba_image_eval.json    # path to the evaluation data json file (optional)
IMAGE_FOLDER=./example_data/images                      # path to the image root folder; if provided, the image paths in the json should be relative
VIDEO_FOLDER=./example_data/videos                      # path to the video root folder; if provided, the video paths in the json should be relative
DEFAULT_NUM_FRAMES=8                                    # if num_frames is not specified in dataset entries, this value will be used to sample frames from videos
USE_LORA=True                                           # whether use lora
Q_LORA=False                                            # whether use q-lora; only effective when USE_LORA is True
LORA_R=8                                                # the lora rank
LORA_ALPHA=8                                            # the lora alpha
RUN_ID=${MODEL_ID}_lora-${USE_LORA}_qlora-${Q_LORA}     # a custom run id that determines the checkpoint folder and wandb run name
DS_STAGE=zero3                                          # deepspeed stage; < zero2 | zero3 >
PER_DEVICE_BATCH_SIZE=2                                 # batch size per GPU
GRAD_ACCUM=1                                            # gradient accumulation steps
NUM_EPOCHS=5                                            # number of training epochs
LR=2e-5                                                 # learning rate
MODEL_MAX_LEN=512                                       # maximum input length of the model
torchrun $DISTRIBUTED_ARGS train.py
--model_id $MODEL_ID
--data_path $TRAIN_DATA_PATH
--eval_data_path $EVAL_DATA_PATH
--image_folder $IMAGE_FOLDER
--video_folder $VIDEO_FOLDER
--default_num_frames $DEFAULT_NUM_FRAMES
--output_dir ./checkpoints/$RUN_ID
--report_to tensorboard
--run_name $RUN_ID
--deepspeed ./ds_configs/${DS_STAGE}.json
--bf16 True
--num_train_epochs $NUM_EPOCHS
--per_device_train_batch_size $PER_DEVICE_BATCH_SIZE
--per_device_eval_batch_size $PER_DEVICE_BATCH_SIZE
--gradient_accumulation_steps $GRAD_ACCUM
--eval_strategy "epoch"
--save_strategy "epoch"
--save_total_limit 1
--learning_rate ${LR}
--weight_decay 0.
--warmup_ratio 0.03
--lr_scheduler_type "cosine"
--logging_steps 1
--tf32 True
--model_max_length $MODEL_MAX_LEN
--gradient_checkpointing True
--dataloader_num_workers 4
--use_lora $USE_LORA
--q_lora $Q_LORA
--lora_r $LORA_R
--lora_alpha $LORA_ALPHA

NUM_GPUS=1
DISTRIBUTED_ARGS="
    --nnodes=1 \
    --nproc_per_node ${NUM_GPUS} \
    --rdzv_backend c10d \
    --rdzv_endpoint localhost:4
"

# arguments that are very likely to be changed
# according to your own case
MODEL_ID=llava-interleave-qwen-0.5b                               # model id; pick on by running `python supported_models.py`
TRAIN_DATA_PATH=./example_data/celeba_image_train.json  # path to the training data json file
EVAL_DATA_PATH=./example_data/celeba_image_eval.json    # path to the evaluation data json file (optional)
IMAGE_FOLDER=./example_data/images                      # path to the image root folder; if provided, the image paths in the json should be relative
VIDEO_FOLDER=./example_data/videos                      # path to the video root folder; if provided, the video paths in the json should be relative
DEFAULT_NUM_FRAMES=8                                    # if `num_frames` is not specified in dataset entries, this value will be used to sample frames from videos

USE_LORA=True                                           # whether use lora
Q_LORA=False                                            # whether use q-lora; only effective when `USE_LORA` is True
LORA_R=8                                                # the lora rank
LORA_ALPHA=8                                            # the lora alpha

RUN_ID=${MODEL_ID}_lora-${USE_LORA}_qlora-${Q_LORA}     # a custom run id that determines the checkpoint folder and wandb run name

DS_STAGE=zero3                                          # deepspeed stage; < zero2 | zero3 >
PER_DEVICE_BATCH_SIZE=2                                 # batch size per GPU
GRAD_ACCUM=1                                            # gradient accumulation steps
NUM_EPOCHS=5                                            # number of training epochs

LR=2e-5                                                 # learning rate
MODEL_MAX_LEN=512                                       # maximum input length of the model

torchrun $DISTRIBUTED_ARGS train.py \
    --model_id $MODEL_ID \
    --data_path $TRAIN_DATA_PATH \
    --eval_data_path $EVAL_DATA_PATH \
    --image_folder $IMAGE_FOLDER \
    --video_folder $VIDEO_FOLDER \
    --default_num_frames $DEFAULT_NUM_FRAMES \
    --output_dir ./checkpoints/$RUN_ID \
    --report_to tensorboard \
    --run_name $RUN_ID \
    --deepspeed ./ds_configs/${DS_STAGE}.json \
    --bf16 True \
    --num_train_epochs $NUM_EPOCHS \
    --per_device_train_batch_size $PER_DEVICE_BATCH_SIZE \
    --per_device_eval_batch_size $PER_DEVICE_BATCH_SIZE \
    --gradient_accumulation_steps $GRAD_ACCUM \
    --eval_strategy "epoch" \
    --save_strategy "epoch" \
    --save_total_limit 1 \
    --learning_rate ${LR} \
    --weight_decay 0. \
    --warmup_ratio 0.03 \
    --lr_scheduler_type "cosine" \
    --logging_steps 1 \
    --tf32 True \
    --model_max_length $MODEL_MAX_LEN \
    --gradient_checkpointing True \
    --dataloader_num_workers 4 \
    --use_lora $USE_LORA \
    --q_lora $Q_LORA \
    --lora_r $LORA_R \
    --lora_alpha $LORA_ALPHA

Thanks. Will post updates here.

I confirm that there is some problem with finding the target modules (partial string keys like "q_proj" are used so the modules in clip's vit will also be included as lora modules). We are actually working on allowing vision encoder to be trained. A fix to this will be made along with those updates. Stay tuned.

So, may I ask how to completely freeze the vision encoder?

For the time being you can try the code in the wip-vision-unfreeze branch, and the example_scripts/example_image.sh in that branch (together with the updated code) achieves fully freezing the vision encoder and projector. Although notice that we have only finished tests for llava-1.5 (which should also apply for llava-interleave since there model class/architecture is the same).

Thanks for your quick reply!!!

The code is merged. Let me know if there are any issues.


Issue LogFile 0KB

hai my name is Boy (student)
i want to ask about log file that was created in SD card on directory called "OBDReaderLogs".
in that folder we should see log file from previous trip from obdreader progrom, But somehow after i try it, the file log was created but there is nothing on it (file 0 kb).
anyone could help please
thanks
(sory for bad english)
grads BOY

Nothing obvious. I use logging a lot and it works. Your best bet is to debug it yourself.


ZFS removed when rebasing on my image

I do not know if this is the right place to raise this issue but maybe there's a simple misunderstanding on my part.
I just recently got around to trying Aurora and was mega-pleased to see ZFS included out of the box as I use ZFS for extra storage on my desktop.
I wanted to build my own image for future customization and started with this image-template, here's the relevant part of my containerfile
ARG SOURCE_IMAGE="aurora"

ARG SOURCE_SUFFIX="-dx-nvidia"

ARG SOURCE_TAG="latest"

FROM ghcr.io/ublue-os/${SOURCE_IMAGE}${SOURCE_SUFFIX}:${SOURCE_TAG}

When I build this and rebase, I get a list of changes that will take place on reboot and one is that the zfs utils are removed.
But if I rebase again on just the stock nvidia dx aurora image then it comes back... Can someone help me with what I'm missing?

You could still add rpm-ostree install + that package to your build.sh

I'm more curious why I'd have to - what's the difference in the tag and the iso?

I do not know if this is the right place to raise this issue but maybe there's a simple misunderstanding on my part.

I believe a more appropriate place to ask this would be our forums ( https://universal-blue.discourse.group/ ) or in Discord ( https://discord.gg/WEu6BdFEtp ).

ARG SOURCE_TAG="latest"

When I build this and rebase, I get a list of changes that will take place on reboot and one is that the zfs utils are removed.

The problem is Aurora (and Bluefin) only include ZFS in the stable tag, but you based your custom image on latest.

Closing since it's not an issue in the image-template repo itself.


Feat(FN-997): improve password protected errors

Introduction
We were returning something went wrong for some errors that including password protected files
Resolution
For these errors we want to return and error message on the page. This might have the copy udpated in the future

Codecov Report

:exclamation: No coverage uploaded for pull request base (main-stbr@fcbdd45). Click here to learn what that means.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             main-stbr    #2186   +/-   ##
============================================
  Coverage             ?   14.16%
============================================
  Files                ?      975
  Lines                ?    22902
  Branches             ?     3594
============================================
  Hits                 ?     3244
  Misses               ?    17173
  Partials             ?     2485

Flag
Coverage Δ

ui-test
50.20% <0.00%> (?)

unit-test
2.79% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


New acquisition instrument for H&E

Please add Leica Biosystems Aperio AT2 for to H&E acquisition instruments.
No longer manufacturer by Leica...here's a reseller link
https://www.medicalexpo.com/prod/leica-biosystems/product-95735-653510.html
Let me know if you have any questions.
Richard

I found the instrument model is already in the RRID database, so I'll just reuse it:
https://scicrunch.org/resolver/RRID:SCR_021256

Cool
From: Josef Hardi @.>
Sent: Wednesday, February 28, 2024 12:44 PM
To: hubmapconsortium/dataset-metadata-spreadsheet @.>
Cc: Morgan, Richard Steven @.>; Author @.>
Subject: Re: [hubmapconsortium/dataset-metadata-spreadsheet] New acquisition instrument for H&E (Issue #4)
I found the instrument model is already in the RRID database, so I'll just reuse it:
https://scicrunch.org/resolver/RRID:SCR_021256

Reply to this email directly, view it on GitHubhttps://github.com/hubmapconsortium/dataset-metadata-spreadsheet/issues/4#issuecomment-1969515475, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEIO5BOZZUE6K77BSKKK2ILYV5UFBAVCNFSM6AAAAABD5XIUAGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNRZGUYTKNBXGU.
You are receiving this because you authored the thread.Message ID<EMAIL_ADDRESS>


Generate a Kotlin enum without the UNKNOWN__ case

Use case
Currently, when statements need to match .UNKNOWN__ every time they're used in a codebase.
when(color) {
  BLUEBERRY -> TODO()
  CANDY -> TODO()
  __UNKNOWN -> TODO()
}

This means I need to think through the UNKNOWN fallback several times.
If the Apollo codegen provided an enum that didn't contain this case, I could instead write
when(color.unwrap()) {
  BLUEBERRY -> TODO()
  CANDY -> TODO()
}

Yes, nothing's currently stopping me from writing an unwrap() extension, but I still need to sprinkle __UNKNOWN throughout my codebase to get the when statements to compile.
This is how Apollo iOS works, btw. GraphQLEnum.unknown is instead a wrapper enum around the core enum. On first glance, you would think Kotlin's approach is nicer because you don't need to match .case(...), but every single when statement needs a default case to handle the .UNKNOWN__, whereas iOS I can just create an unwrapper at the top level of my project to handle .unknown once.

Describe the solution you'd like

Apollo Kotlin already generates knownEntries List. If it just provided this exact thing in enum format I could write my own project level unwrap() and my individual when statements would never need to worry about .UNKNOWN__.
More context
Discord thread

For the record, after using both iOS & Kotlin Apollo libraries, I do like Apollo Kotlin's enum approach better as a starting point. Seeing Getting Started examples that have .case(..) is kinda gross on iOS. But I'd say Apollo iOS wins for the power use cases once you figure out how to write your own unwrap() stuff.
Ideally, Apollo Kotlin could just codegen a knownEntries enum and that's the best of both worlds.

@joshuakcockrell an implementation is available at https://github.com/apollographql/apollo-kotlin/pull/6248. Let us know what you think

Wow, that's a crazy fast turnaround on this! I'm excited to test this out. Will let you know how it goes.

Damn, I didn't mean to close this issue so fast, forgot that merging the PR would close the issue 🤦
In all cases, let us know how it goes, it's available in the SNAPSHOTs now.

@martinbonnin  I've been having difficulty getting the snapshot working. I got 4.1.1-SNAPSHOT working but couldn't see any difference in the generated code. I'll try again today.


chore(typescript_indexer): group related test files in subdirectories.

Tests that verify indexing of importing/exporting symbols require indexing two or more files at the same time. Currently some of these tests live in the root testdata directory which means that each file is indexed and verified individually defeating the purpose of the test. Moving them to separate _group directories solves that.

I thought the same thing, but it is meaningful: https://github.com/kythe/kythe/blob/master/kythe/typescript/test.ts#L150


make conda-forge package

https://conda-forge.org/docs/maintainer/adding_pkgs.html
https://python-packaging-tutorial.readthedocs.io/en/latest/conda.html

Created recipe, built succesfully, uploaded to Anaconda cloud.
Added recipe in commit 43ec69c22ee2bdd4765d9126c841bece98dbef60

Whoops, closed the wrong issue -- this one is for conda-forge

Hey, man! Long time no see. I'm happy to help out getting this up on CF, if that's something you're still interested in pursuing. Given the novel deps (crowsetta, etc) you have there are pretty tightly bound to this problem domain, it would probably be reasonable to get them all up in one go. Keeping TF up-to-date is a pretty big job, so you might be hurting a bit there for specific versions, but otherwise seems pretty straightforward.
 Again there, you can't rely on GPU, i don't think.

@bollwyvl !!! How are you doing?!
Yes I would definitely love to get this and crowsetta on conda forge.
I am like literally almost moved to tears that you would offer to help.
I'm sort of in the weeds with this and other things -- could I maybe ping you when we're closer to submitting a paper for this? Guessing near the end of June at the latest. I think my collaborator @yardencsGitHub will kill me if I don't put out other fires with the code first but we definitely want to make it as easy to use as possible once we're there with it
vak no longer depends on TF, we switched to PyTorch, not sure if that makes it easier or harder.
And yes definitely want to set up some binder demos too -- I think we could use saved model checkpoints to demo segmenting birdsong syllables in spectrograms without needing a GPU

How are you doing?!

All good, despite all the weirdness out there. Actually doing some plumbing work in the reinforcement learning space, and have been casting about for things that aren't playing atari games or getting sentimental about (figurative) tweets.

could I maybe ping you when we're closer to submitting a paper for this?

Sure, whenever!

vak no longer depends on TF, we switched to PyTorch, not sure if that makes it easier or harder.

Actually harder, from a conda-forge perspective: pytorch is hard enough to package that the torch folks run their own conda shop, which doesn't always play well with conda-forge. The best we have from that perspective is a cpu-only build, and like I said, it lags behind some.
Not to be too distracting: the easiest way to dance around it is to have basically everything that isn't PT/TF in install_requires, and have an extras_require that includes your "good stuff". So you tell your pip users to pip install vak[cpu] or vak[gpu]. Gross, to be sure, but would get over the bar. Make the base at least vak --version and import vak without that stuff, and it can get over the "what happens in conda-forge stays in conda-forge" bar, while you can happily include in the docs conda install -c pytorch -c defaults -c conda-forge vak pytorch and get something that Works For Real. It might even be possible to run_constrained packages that aren't even in conda-forge, such that the versions will line up. I would have to investigate.

want to set up some binder demos

That's actually a much easier place to start, since it could in fact use your upstream library of choice, from wherever you need it, or do apt-get stuff, etc. But yeah, no GPU shinies.

saved model checkpoints

These are actually great candidates for packaging, as we do for spacy models and a few other things. Seems crazy to be slinging hundred-megabyte files around as packages, but with all the hard-linking that conda (can) does, it's actually pretty efficient, and captures the metadata well.

And good luck on the paper!

hey @bollwyvl any chance I could borrow a few minutes of your time about this?
I can't even get my old recipes to work so I can put up on my own channel 😢 and it is completely not clear to me why
Maybe some evening later this week?
paper is finally up on biorxiv, yay 🎉
https://www.biorxiv.org/content/10.1101/2<IP_ADDRESS>2088v1.full.pdf

Congrats on the DOI!
Let's hit it some time after Wednesday (pydata triangle talk). Would be
cool to get your stuff into one of the collaboration envs we've been
working in https://github.com/deathbeds/_fam
So you can demo where people can play.

thank you
better a DOI than DOA as Tom Waits never used to say
!
Hope the talk goes well
Thursday or Friday after 5 works for me, or even the weekend if by any chance you're free.
and yes! would love to demo
although Tony might be very sick of hearing me talk about songbirds at this point
I'll segment some bat calls just to change it up

Hey @bollwyvl just pinging you again -- hope the talk went well.
Please let me if there's a time early next week we could meet

Fixed by https://github.com/conda-forge/staged-recipes/pull/17426#issuecomment-1007710541
Thank you again @bollwyvl for introducing me to grayskull and helping me figure out what I needed to fix about dependencies

😎 Congrats! And feel free to @ me if you ever run into trouble.

🙏 thank you


[Storage] Increment versions after STG95 preview release + fix flaky paid_bursting live-test

🕶

API change check
API changes are not detected in this pull request.


rbac: pods/log actions

My k8s environment does not currently allow  Verbs:["create" "update" "patch" "delete"] for Resources:["pods/log"]
Any insight as to why these permissions are needed?
Could "pods/log" be limited to ["get" "watch" "list"]?
e.g.
Resources:["pods/log"] -> Verbs:["get" "watch" "list"]
Resources:["pods", "pods/attach", "pods/exec"] -> Verbs:["get" "watch" "list" "create" "update" "patch" "delete"]

I'm not sure of the exact reason, but it might be worth a try to modifying the RBAC yourself and testing whether the product still works.

Ahh interesting! Thanks for reporting. I think this is probably just a holdover from us shoving pods/logs in with the other pods resources here:
https://github.com/rstudio/helm/blob/cf51385a88a913af34db39cef0422f417724da63/charts/rstudio-library/templates/_rbac.tpl#L79-L83
I don't expect that we would have any issues restricting this!


Deprecation improvements

This hopefully addresses the crux of this issue:
https://github.com/RicoSuter/NJsonSchema/issues/1031
and will unblock this enhancement in NSwag:
https://github.com/RicoSuter/NSwag/issues/2595
Along with a change to use the native deprecated attribute in OpenAPI 3.0 instead of the x-deprecated extension (#1208)
Ultimately this allows the retention of [Obsolete("Reason")] on classes and properties between code and generated client.

Lgtm 👍 thx


Windows docker build tools and fixes

This PR is adding manage.ps1 tool to manage docker images on windows and allowing them to by run for development. It is also changing base image so it is using python 3.11 (because shotgrid api isn't compatible with py 3.12). And last thing - it is removing the need for symlinking shotgrid_common directory to the services, because doing this in dev mode will break subsequent docker image builds.
Testing
On Windows, manage.ps1 can be used for building, cleaning and running service images in similar way as original make on Linux.
On all platforms, you should be able to build services and run them as usual.

Lets close it for now and see if you will reopen it later. Thank you.


Feature/changelog ids

When the changelog pipeline was reworked in #84, we switched over to using the forum id as the changelog id that its stored in. After hero lab's released (which don't have a forum id), we needed to start making up changelog id's. Now, the changelog id is made up but in inconsistent formats with no intended usage on the frontend.
This PR aims to use the date as the changelog-id in preparation of using them for wiki page names, i.e. Data:changelog_id.json and Update:<changelog_id>. However, unlike before, if multiple changelogs are released on the same day, they will have a number appended at the end. For example, most changelogs id's will look like 2024-12-07 or 2024-12-07_HeroLab, however, on October 18th they released two patches, so the id's would be 2024-10-18 and 2024-10-18-1.
Additionally, each config in changelog_configs now has boolean flag is_hero_lab. Though it isn't used anywhere yet, I expect this to make it easier to display herolab or non-herolab specific patches on the wiki's side.
TODOS:

Add isHeroLab to changelog configs
Cleanup code a bit in _create_changelog_id. I'm not very happy with the elegance of how the solution is written, buut it works lol. ok its a bit better now ok its a lot better now
Test it more thoroughly when next patch comes out tested scenario where two patches are released on same day, and scenario where two patches are released on different days, both passed
Swap underscores for hyphens in changelog-ids this was done because underscores are replaced with a space in wiki page names, otherwise making the page names appear awkwardly as 2024 12 10

Parsed data in deadlock-data PR

@hassayag Ready for review- be sure to reread the top conversation post as I made many edits. Also, not sure which label to put for this one, infra or just enhancement? It minorly changes infrastructure of stored changelog data, so somewhere in between.


Correction of the Python scripts

Hey ~
When you'll have the time, can you quickly review the /bin/ Python scripts ?
The idea is to propose their addition via a feature branch in the mgnify-pipelines-toolkit (but it will depend on the time I have left and corrections to be made).

Note that the scripts were a bit modified since the last PR (and the modifications are not only related to the last commit)


Fix the fullname refs overlooked in #2177

@dae0eeWi Thanks for the PR, could you please sign the CLA? We could get this change in asap

cc: https://github.com/kubernetes/charts/issues/2449

Ok CLA done

/ok-to-test

/assign

/lgtm
/approve


Redefinition of read macros fails an ASDF recompile.

When recompiling a file with a read macro, (named-read-macros:define) warns with a cl:warning. That warning results in ASDF flagging the compilation as unsuccessful. Instead, (define) should warn with a subtype of cl:style-warning.
Here's an example how to fix the recompilation issue. I used SBCL's sb-impl:redefinition-warning as a base.
The warning is exported so it can be handled.
diff --git a/named-read-macros.lisp b/named-read-macros.lisp
index ca10abf..9393e82 100644
--- a/named-read-macros.lisp
+++ b/named-read-macros.lisp
@@ -27,6 +27,20 @@

 (in-package #:named-read-macros)

+(define-condition redefinition-warning-read-macro (style-warning)
+  ((name
+    :initarg :name
+    :reader redefinition-warning-read-macro-name)
+   (old-definition
+    :initarg :old-definition
+    :reader redefinition-warning-read-macro-old-definition))
+  (:report (lambda (c stream)
+            (format stream (case (redefinition-warning-read-macro-old-definition c)
+                    (:read-macro "Redefining existing read macro ~*~S.")
+                    (otherwise "Redefining ~(~a~) ~S as read macro."))
+                    (redefinition-warning-read-macro-old-definition c)
+                    (redefinition-warning-read-macro-name c)))))
+
 (defun readtable-case-transform-fn (&optional (readtable *readtable*))
   "Return a function which will transform any string per the given
    readtable's case-sensitivity."
@@ -69,13 +83,13 @@

 (defun check-if-bound (symb)
   (when (fboundp symb)
-    (warn "Redefining function ~S as read macro." symb)
+    (warn 'redefinition-warning-read-macro :name symb :old-definition :function)
     (fmakunbound symb))
   (when (boundp symb)
-    (warn "Redefining variable ~S as read macro." symb)
+    (warn 'redefinition-warning-read-macro :name symb :old-definition :variable)
     (makunbound symb))
   (when (get symb 'read-macro)
-    (warn "Redefining existing read macro ~S." symb)))
+    (warn 'redefinition-warning-read-macro :name symb :old-definition :read-macro))

 (defun read-maybe-read-macro (stream &optional char)
   (declare (ignorable char))
diff --git a/packages.lisp b/packages.lisp
index caf9306..8aaa2e2 100644
--- a/packages.lisp
+++ b/packages.lisp
@@ -32,4 +32,7 @@
            #:readtable-mixin)
   (:export #:readtable
            #:readtable-mixin
-           #:define))
+           #:define
+           #:redefinition-warning-read-macro
+          #:redefinition-warning-read-macro-name
+          #:redefinition-warning-read-macro-old-definition))

Resolved in 4dde265cb9bd44610e73ebfabeb7aacc258e9f8a


EOL content should probably not be indexed anymore

https://eol.org/
An error occurred during a connection to eol.org. Peer’s Certificate has been revoked. Error code: SEC_ERROR_REVOKED_CERTIFICATE

    The page you are trying to view cannot be shown because the authenticity of the received data could not be verified.
    Please contact the website owners to inform them of this problem.

As a result of the invalid certificate, none of the images are loading anymore.

I tweeted at them to let them know.

Their SSL certificate seems to be back up so I'm closing this issue.


DeepAI Image Processing API

🎯 Title and Issue Number
DeepAI Image Processing API #407

Closes #407 <issue_no>

🗒 Checklist:

[x] I have mentioned the issue number in my Pull Request.
[x]  I have gone through rules of when PR will get merged.
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have created a helpful and easy to understand README.md
[x] I have followed proper file structure.
[x] I have gone through CONTRIBUTING GUIDELINES.md.

@dinxsh view this PR

Hey @revanth1718, Thank you for creating PR! We will review it super soon. 😇❣
As we continue to evolve and innovate, we encourage you to share your ideas, feedback, and code to help us push the boundaries of what's possible in the world of APIs🚀.
We hope you have followed CONTRIBUTING GUIDELINES.
Thank you for being an essential part of our community. Together, we'll keep building amazing things!
Don’t forget to ⭐ our repository!
Happy Coding!✨
Will See you soon❣

@Kritika30032002, view this updated PR


SecurityInsights[GA]

All SDK Contribution checklist:
Update for GA
https://github.com/Azure/azure-rest-api-specs/pull/13156
This checklist is used to make sure that common guidelines for a pull request are followed.

[X] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
[X] I have read the contribution guidelines.
[X] The pull request does not introduce breaking changes.

General Guidelines and Best Practices

[X] Title of the pull request is clear and informative.
[X] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[X] Pull request includes test coverage for the included changes.

SDK Generation Guidelines

[X] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
[X] The *.csproj and AssemblyInfo.cs files have been updated with the new version of the SDK. Please double check nuget.org current release version.

Additional management plane SDK specific contribution checklist:
Note: Only applies to Microsoft.Azure.Management.[RP] or Azure.ResourceManager.[RP]

[X] Include updated management metadata.
[X] Update AzureRP.props to add/remove version info to maintain up to date API versions.

Management plane SDK Troubleshooting

If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add new service label and/or contact assigned reviewer.
If the check fails at the Verify Code Generation step, please ensure:

Do not modify any code in generated folders.
Do not selectively include/remove generated files in the PR.
Do use generate.ps1/cmd to generate this PR instead of calling autorest directly.
Please pay attention to the @microsoft.csharp version output after running generate.ps1. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version,

Old outstanding PR cleanup
Please note:
If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

@nisha-bhatia
Here are the PRs per our discussion:
https://github.com/Azure/azure-rest-api-specs/pull/13137
https://github.com/Azure/azure-rest-api-specs/pull/12556
These both have approved breaking changes.