Issues with account signup and login

Hi,
I have installed mydata-sdk using docker and I was able to open the corresponding web page http://<IP_ADDRESS>:8080.
However, when creating a new user account (sign-up), I was getting the following error:
2016-11-22 14:46:51,118 - app.mod_database.helpers in function log_query at line: 27 - DEBUG - SQL query to execute: "INSERT INTO MyDataAccount.Particulars (firstname, lastname, dateOfBirth, img_url, Accounts_id) VALUES (test, test, STR_TO_DATE(22-11-2016, '%Y-%m-%d'), img/avatars/mydata-avatar.png, 1)" 2016-11-22 14:46:51,118 - app.mod_database.helpers in function execute_sql_insert_2 at line: 98 - DEBUG - Error in SQL query execution: OperationalError(1292, "Truncated incorrect date value: '22-11-2016'")
I was able to fix the bug, by updating the lines "STR_TO_DATE(%s, '%%Y-%%m-%%d')" to "STR_TO_DATE(%s, '%%d-%%m-%%Y')" in the following file: Account/app/mod_database/models.py
Then, after having successfully created a new account, I'm getting the below error message when I try to login:
2016-11-22 14:50:02,301 - mod_auth_helpers in function get_account_by_username_and_password at line: 157 - DEBUG - Authenticated 2016-11-22 14:50:02,301 - mod_auth_helpers in function get_account_by_id at line: 25 - DEBUG - User info by acoount_id 2016-11-22 14:50:02,301 - mod_auth_helpers in function get_account_by_id at line: 27 - DEBUG - account_id: 1 2016-11-22 14:50:02,301 - mod_auth_helpers in function get_account_by_id at line: 48 - DEBUG - sql_query: "SELECT MyDataAccount.Accounts.id, MyDataAccount.LocalIdentities.id, MyDataAccount.LocalIdentities.username, MyDataAccount.Particulars.firstname, MyDataAccount.Particulars.lastname, MyDataAccount.Emails.email, MyDataAccount.Particulars.img_url, MyDataAccount.Particulars.dateOfBirth FROM MyDataAccount.Accounts INNER JOIN MyDataAccount.LocalIdentities ON MyDataAccount.Accounts.id = MyDataAccount.LocalIdentities.Accounts_id INNER JOIN MyDataAccount.Particulars ON MyDataAccount.Accounts.id = MyDataAccount.Particulars.Accounts_id INNER JOIN MyDataAccount.Emails ON MyDataAccount.Accounts.id = MyDataAccount.Emails.Accounts_id WHERE MyDataAccount.Accounts.id = '1' AND MyDataAccount.Emails.prime = 1" 2016-11-22 14:50:02,302 - mod_auth_helpers in function get_account_by_id at line: 54 - DEBUG - data: None  2016-11-22 14:50:02,302 - mod_auth_helpers in function get_account_by_id at line: 66 - DEBUG - Account not found: TypeError("'NoneType' object has no attribute '__getitem__'",) 2016-11-22 14:50:02,303 - mod_auth_helpers in function get_account_by_id at line: 69 - DEBUG - Exception: TypeError("'NoneType' object has no attribute '__getitem__'",) 2016-11-22 14:50:02,303 - mod_auth_controllers in function post at line: 59 - DEBUG - registered_user: None

Hi elyesbh!
Thanks for reporting this issue.
We have actually been discussing that should we even include a UI for MyData Account as the current one is more or less just a mockup from last spring. Current focus is to develop MyData Account as REST-service and then later provide a UI that uses this REST API. Current version is implemented by populating and rendering Jinja-templates in the backend.
Nevertheless we'll look into it but in the mean time you can verify that you have successfully deployed by running ui_flow.py without parameters. It should print "201 CREATED" if Consent Record was successfully delivered by the Operator to the Sink.

Thanks Hjhsalo for the clarifications.
I tried to run ui_flow.py (after a fresh redeploy) and I'm getting the below errors:
python ./ui_flow.py
http://localhost:8080/
http://localhost:5000/
False
582f2bf50cf2f4663ec4f020
582f2bf50cf2f4663ec4f01f
##### CREATE USER ACCOUNTS #####
NOTE: Throws an error if run for second time as you cannot create more accounts with same unique usernames. (Will be fixed in later releases.)
(500, 'Internal Server Error', u'{\n    "errors": {\n        "code": "500", \n        "detail": "OperationalError(1411, \\"Incorrect datetime value: \'2010-05-14\' for function str_to_date\\")", \n        "source": "/api/accounts/", \n        "status": "Internal Server Error, Server got itself in trouble", \n        "title": "Could not create Account"\n    }\n}', u'http://localhost:8080/api/accounts/')
...
##### CREATE A SERVICE LINK #####
Creation of first SLR failed with status (500) reason (INTERNAL SERVER ERROR) and the following content:
{
  "errors": [
    {
      "status": 500,
      "count": 0,
      "trace": null,
      "title": "INTERNAL SERVER ERROR",
      "detail": {
        "msg": "Something went wrong while Logging in with code to Service_Components Mgmnt",
        "Error from Service_Components Mgmnt": {
          "errors": [
            {
              "status": 500,
              "count": 0,
              "trace": [
                "Traceback (most recent call last):",
                "  File \"/mydata-sdk-components/Service_Components/Service_Mgmnt/service_mgmnt.py\", line 156, in post",
                "    title=result.reason)",
                "DetailedHTTPException: 500: Internal Server Error"
              ],
              "title": "INTERNAL SERVER ERROR",
              "detail": {
                "msg": "Something went wrong while redirecting verified code to Service_Components",
                "Error from Service_Components": {
                  "errors": [
                    {
                      "status": 500,
                      "count": 0,
                      "trace": [
                        "Traceback (most recent call last):",
                        "  File \"/mydata-sdk-components/Service_Mockup/DetailedHTTPException.py\", line 17, in wrapper",
                        "    result = method(self, *args, **kw)",
                        "  File \"/mydata-sdk-components/Service_Mockup/Service/service.py\", line 87, in post",
                        "    title=result.reason)",
                        "DetailedHTTPException: 500: Internal Server Error"
                      ],
                      "title": "INTERNAL SERVER ERROR",
                      "detail": {
                        "msg": "Something went wrong while posting to Service_Components Mgmnt to inform login was successful and its alright to generate Surrogate_ID ",
                        "Error from Service_Components Mgmnt": {
                          "errors": [
                            {
                              "status": 500,
                              "count": 0,
                              "trace": [
                                "Traceback (most recent call last):",
                                "  File \"/mydata-sdk-components/Service_Components/Service_Mgmnt/service_mgmnt.py\", line 122, in post",
                                "    title=result.reason)",
                                "DetailedHTTPException: 500: Internal Server Error"
                              ],
                              "title": "INTERNAL SERVER ERROR",
                              "detail": {
                                "msg": "Something went wrong while posting to Operator_SLR for /link",
                                "Error from Operator_SLR": {
                                  "errors": [
                                    {
                                      "status": 500,
                                      "count": 0,
                                      "trace": [
                                        "Traceback (most recent call last):",
                                        "  File \"/mydata-sdk-components/Operator_Components/DetailedHTTPException.py\", line 17, in wrapper",
                                        "    result = method(self, *args, **kw)",
                                        "  File \"/mydata-sdk-components/Operator_Components/Operator_SLR/registerSur.py\", line 185, in post",
                                        "    raise e",
                                        "DetailedHTTPException: 500: Internal Server Error"
                                      ],
                                      "title": "Internal Server Error",
                                      "detail": {
                                        "msg": "Getting surrogate_id from account management failed.",
                                        "content": {
                                          "errors": {
                                            "status": "Internal Server Error, Server got itself in trouble",
                                            "source": "/api/account/2/servicelink/",
                                            "code": "500",
                                            "detail": "KeyNotFoundError('Key for account not found from database', 'Could not get JWK object', 'Could not get public key from database')",
                                            "title": "Failed to get account owner's public key"
                                          }
                                        }
                                      },
                                      "source": "Not resolved",
                                      "id": "4d4df4fd-38a7-4e29-84a2-4012a11a9477"
                                    }
                                  ]
                                }
                              },
                              "source": "Not resolved",
                              "id": "41a27e92-40e1-41d2-a8c5-ce0a3adb1f9a"
                            }
                          ]
                        }
                      },
                      "source": "Not resolved",
                      "id": "f9d5e68b-fdcd-49ca-8952-ddc615685fd3"
                    }
                  ]
                }
              },
              "source": "Not resolved",
              "id": "7b6ed838-89ef-400c-a507-78df88fc79c7"
            }
          ]
        }
      },
      "source": null,
      "id": "b7689aa7-5ea3-46bd-a2d2-65480d579430"
    },
    {
      "status": 500,
      "count": 1,
      "trace": [
        "Traceback (most recent call last):",
        "  File \"/mydata-sdk-components/Operator_Components/Operator_SLR/start.py\", line 115, in get",
        "    title=result.reason)",
        "DetailedHTTPException: 500: Internal Server Error"
      ],
      "title": "SLR registration failed.",
      "detail": "Something failed during creation of SLR.",
      "source": "Not resolved",
      "id": "443cb8e2-34de-4405-b2a2-528d9f708116"
    }
  ]
}

I got it to work with following instructions
git clone https://github.com/HIIT/mydata-sdk
cd mydata-sdk
sudo sh start.sh  # Needed to run root only if you haven't configre docker to work with normal users

Wait till the stack has properly started
last message I see is
mysql-db                  | Version: '5.6.34'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server (GPL)
Now open another terminal and run the ui_flow
 python ui_flow.py

I'll include these start.sh / docker-compose -instructions in readme.md

Ok, thanks. I have tested the above four commands and my deployment is now ok ("status": 201, "msg": "CREATED"). I will focus on the REST APIs until the UI is fixed.


DR-922 - Send missing exit code when exiting the app

Background
Travis CI was succeeding even if the protractor tests fail on SauceLabs.
Change
Send the exit code on the close event.
Pending to be done
Revisit the SauceLabs badge that is showing "unknown" state. This error might be related wite the bug mentioned on this comments.

Nice work with the refactoring @gastonmancini !!
Does it pass the tests? in that case :shipit: !

Thanks @arzafran!


PR checklist

[ ] Addresses an existing issue: #0000
[x] New feature, bugfix, or enhancement

[x] Includes tests

[ ] Documentation update

Overview of change:
New rule, which determines whether a space is required before and/or after question and colon tokens in ternary conditional operator

Thanks for your interest in palantir/tslint, @arhontmw! Before we can accept your pull request, you need to sign our contributor license agreement - just visit https://cla.palantir.com/ and follow the instructions. Once you sign, I'll automatically update this pull request.

Hey @arhontmw, is there an issue where this change is discussed? Currently most (if not all) of whitespace linting is done by the whitespace rule and it would be good to have a discussion about the pros and cons of separating that rule into several more specific rules. If there is not an issue, feel free to create one.

Please see #4141 before you contribute to this project. Thank you!

Per discussion in #4122, and more broadly the upcoming deprecation of TSLint (#4534), closing this issue for housekeeping. @arhontmw you can always publish this rule in a standalone npm package if you'd like to see it used!


Add support for png in load_video_frames

I added support for "png" in load_video_frames and added sample code and data in the notebooks

marge with main branch


Increment version for face releases

Increment package version after release of Azure.AI.Vision.Face

API change check
API changes are not detected in this pull request.


update v3relay article from stub to article

Currently fails -> [text][topic version 3 transaction relay] doesn't want to formulate into html for some reason.
I hope the content of update is something the reviewers are happy with. Not a huge change, just added more details from what I could understand from the Sept/Oct 2022 bdev mailing lists.

re. failed test -> Logs say the 'excerpt' header is missing. I assumed excerpts were only for stub articles, which this isn't anymore (with the added word-count).
will try to fix and re-check

in case anyone is interested - the current test failure comes from the following:
I added hyperlinks via [this is text][topic version 3 transaction relay] manually. It didn't convert automatically to html.
I am at something of an impasse, since all other markdown files that use the [text][topic x] format seem to just work on their own.

@Xekyo
1 I squashed the commits, accidentally to a new PR. Excuse me. [#1004]. As such I'll close this branch.
2. I noticed a link wasn't forming properly on my local build: [line 66] - topic ephemeral anchors. There is no shorthand for that topic, and ephemeral anchors is spelt correctly


Is there a Migration guide for 2 -> 3 using EmbeddedJavalin?

Trying to upgrade from 2.5.0 to 3.1.0 and running into issues where routes are now returning 404s. I thought createStandaloneApp was the replacement for EmbeddedJavalin.
Old Way (2.5.0) - Worked
  public static JavalinServlet createServlet(String contextPath) {
    return EmbeddedJavalin.create()
        .disableStartupBanner()
        .defaultContentType("application/json")
        .enableAutogeneratedEtags() // Helps with caching
        .contextPath(contextPath)
        .enableCaseSensitiveUrls()
        .createServlet();
  }

New Way (3.1.0) - Doesn't Work
  public static Javalin createStandaloneApp(String contextPath) {
    return Javalin.createStandalone(
        config -> {
          config.prefer405over404 = true;
          config.defaultContentType = "application/json";
          config.showJavalinBanner = true;
          config.autogenerateEtags = true; // Helps with caching
          config.contextPath = contextPath;
        });
  }

@WebServlet(
  urlPatterns = {"/test/*"},
  name = "TestApplication"
)
public class TestApplication extends HttpServlet {

  private Javalin app = JavalinUtils.createStandaloneApp("/test");
  app.get("/hello", ctx -> ctx.json(message("hello")));

  ...

  @Override
  public void service(HttpServletRequest req, HttpServletResponse resp)
      throws ServletException, IOException {
    app.servlet().service(req, resp);
  }

I thought createStandaloneApp was the replacement for EmbeddedJavalin.

It is. What you're doing should work. This is how I have been testing it:
Javalin app = Javalin.createStandalone(config -> {
    config.registerPlugin(new RouteOverviewPlugin("/overview"));
    config.requestLogger((ctx, timeInMs) -> {
        System.out.println("Took " + timeInMs + "ms");
    });
}).get("/hello", ctx -> ctx.result("Hello Javalin"));

@WebServlet(name = "MyServlet", urlPatterns = {"/"})
public class HelloServlet extends HttpServlet {

    Javalin app = Javalin.createStandalone(config -> {
        config.registerPlugin(new RouteOverviewPlugin("/overview"));
        config.requestLogger((ctx, timeInMs) -> {
            System.out.println("Took " + timeInMs + "ms");
        });
    }).get("/hello", ctx -> ctx.result("Hello Javalin"));

    @Override
    protected void doGet(HttpServletRequest req, HttpServletResponse resp) throws ServletException, IOException {
        app.servlet().service(req, resp);
    }

}

I've been running this on an embedded tomcat server. Can you test if this works?

Modified a bit because the system I'm on can't serve directly on / (please note that these urlPatterns worked fine on 2.5.0)
@WebServlet(
  name = "MyServlet",
  urlPatterns = {"/search/catalog/internal/abc/test/*"}
)
public class HelloServlet extends HttpServlet {

  private static final Logger LOGGER = LoggerFactory.getLogger(HelloServlet.class);

  Javalin app =
      Javalin.createStandalone(
              config -> {
                config.registerPlugin(new RouteOverviewPlugin("/overview"));
                config.requestLogger(
                    (ctx, timeInMs) -> {
                      LOGGER.warn("Took {}ms", timeInMs);
                    });
              })
          .get("/", ctx -> ctx.result("Root Route Javalin"))
          .get("/hello", ctx -> ctx.result("Hello Javalin"));

  @Override
  protected void doGet(HttpServletRequest req, HttpServletResponse resp)
      throws ServletException, IOException {
    app.servlet().service(req, resp);
    LOGGER.warn("doGet was called");
  }

  @Override
  protected void service(HttpServletRequest req, HttpServletResponse resp)
      throws ServletException, IOException {
    app.servlet().service(req, resp);
    LOGGER.warn("service was called");
  }
}

Tried these with no luck, still getting 404s:
https://localhost:8993/search/catalog/internal/abc/test
https://localhost:8993/search/catalog/internal/abc/test/overview
https://localhost:8993/search/catalog/internal/abc/test/hello

I did also notice that doGet was never getting called, so I had to use the service overload.
The request logger is getting triggered, each request takes between .10ms and .15ms.

Additionally, when stuck in a break point at that log statement, I can see context and that it did not match the path.

Thanks! Could you look into what's changed?

@mvysny have you migrated to 3.1.0 yet?

Hi, yes, just moved to Javalin 3.1.0 yesterday, works for me. For some reason you need to repeat the context root of the servlet in the get() method, e.g.
.get("/search/catalog/internal/abc/test", ctx -> ctx.result("Root Route Javalin"))

Thanks! I must have messed something up when I moved the context path out from JavalinServlet.

I tried changing tomcat.addServlet("", "Javalin", app.servlet()); to tomcat.addServlet("/context-path", "Javalin", app.servlet());, and Tomcat throws a NullPointerException for some reason. Could you create an example repo @Bdthomson ?

I am getting same problem with javalin 3.5.0 running standalone as a servlet on Jetty 9.4.12.v20180830.

@SheridanG Strange that embedded and standalone behave differently. It shouldn't be a difficult fix though, could you have a look?

I got this working in Tomcat with:
StandardContext ctx = (StandardContext) tomcat.addWebapp("/context-path", new File(webappDirLocation).getAbsolutePath());
tomcat.addServlet("/context-path", "Javalin", app.servlet());

Routes are matched correctly, and System.out.println(ctx.contextPath()); prints the context-path.
There is no need to prefix your get(path, handler) calls with the context-path.
I'm guessing you haven't configured your servlet-container with the correct context-path if you're having issues with this.


getting streetcodes on main page with pagination/front

dev
JIRA

Main JIRA ticket

Code reviewers

[ ] @github_username

Second Level Review

[ ] @github_username

Summary of issue
ToDo
Summary of change
ToDo
Testing approach
ToDo
CHECK LIST

[ ]  СI passed
[ ]  Сode coverage >=95%
[ ]  PR is reviewed manually again (to make sure you have 100% ready code)
[ ]  All reviewers agreed to merge the PR
[ ]  I've checked new feature as logged in and logged out user if needed
[ ]  PR meets all conventions

Issue with loading of all streetcodes can be reproduced only with strict mode


Paris P2P #5 - 2020-01-08

Info

Official link: https://p2p.paris/en/event/monthly-5/
Meetup link: https://www.meetup.com/France-P2P/events/265590715/

Talks

available slot
available slot

This meetup is a part of the Paris P2P Festival #55


Support standard Bower package layouts

WCT should work when dependencies are installed into the standard location of bower_components/, or whatever the .bowerrc file points to if there is one.

@morethanreal FYI

Done! https://github.com/Polymer/web-component-tester/commit/1f0abf4c6ba42efd164691b1824257a0badfe8c4

:+1:


Move custom-extensions test app into options test app

Is your feature request related to a problem? Please describe.
There's no reason to have a dedicated app for testing the custom extension config, it slows things down unnecessarily (if only by a small amount).
Describe the solution you'd like
Move the custom-extensions tests into options
How important is this feature to you?
low hanging fruit but also low priority

Plucked that low hanging fruit :)


Sequential() should cancel if one of the steps fails

Describe the bug
If next build fails it will continue on to the next step in the sequential array. This should probably cancel any remaining steps.
To Reproduce
add a sequential function with an array, make the first step fail and the second step just echo something to show it runs
Your Scripts file (scripts.ts, scripts.js, etc)
import { scripts, sequential } from "scriptful";

export default scripts({
  build: sequential(["next build", "next-sitemap"])
});

Expected behavior
It would make sense that it stops after a step fails
Dependency Versions:

Nodejs: v18.12.1
Dependency Manager: pnpm
Language: Typescript

Additionally parallel() should fail and stop if any of the actions exit with an error. Like the suggestion above it would be great if this was configurable.

By default a sequential() flow will now stop (as of version 1.2.0) if one of the steps fails and won't continue on, this was caused by returning the promise, instead of awaiting it inside the trycatch. As of version 1.2.1 you can set 'continueOnFailure' to true in the command() function to stop this from happening and continue on even in the case of failure of a step. (Eg typescript will generally still emit javascript even in the case of typescript errors)


Remove optional tags

Remove optional tags as suggested in this section of the Google html styleguide.

@alygerharter @prabenzom Do you think this is a good idea?


[LIVY-11] Enable HA support

What changes were proposed in this pull request?
This pull request enables Active/Passive HA in Livy through the use of Zookeeper. The CuratorElectorService class coordinates leadership election between multiple Livy instances
https://issues.apache.org/jira/browse/LIVY-11
How was this patch tested?
unit tests
manual verification using 2 Livy instances

How does this pr related to pr #189 ?

Do you need a proxy-like thing to find the latest active node?

How do the clients know the latest active node? Do they need to ask apache curator? If so, do we need to update the client code?

Another question is if the current leader crash and a new leader is elected, should the session state in the old leader be restored in the new leader?

Another question is if the current leader crash and a new leader is elected, should the session state in the old leader be restored in the new leader?

The code does not do the state synchronization related to the Session State. Is it a good choice to put it in zk?

How do the clients know the latest active node? Do they need to ask apache curator? If so, do we need to update the client code?
When people use a restful client(e.g. curl) to communicate with Livy, should they query zk every time?

#189 implements Livy Server discovery to provide the ability to get current Livy Server address by client to use it in REST requests. There is Java/Scala API for it. If someone uses not Java world client then he should ask ZK to get the address.

When HA mode is enabled, the following happens.
Once new Livy Server starts, it uses Curator to connect to the Zookeeper state store to try to acquire leadership. The process will wait until it is able to acquire leadership. The leader latch library will automatically ensure that only 1 Livy Server among those that are connect to that state store will be elected Leader at any point.
Once it acquires leadership, it starts the Livy Web Server in the same way that it's currently handled, recovering session state if it is configured and all other associated configurations.
The client ideally doesn't need to do anything with respect to contacting the zookeeper server, as ideally you have a load balancer of some sort failover controller to eventually link the client to the actively running Livy instance. This solution is primarily concerned with ensuring that given a group of Livy Servers deployed in HA mode, exactly one of them will be active and running at any one time.

Another question is if the current leader crash and a new leader is elected, should the session state in the old leader be restored in the new leader?

The code does not do the state synchronization related to the Session State. Is it a good choice to put it in zk?

This is already implemented previously. You can set livy.server.recovery.state-store to "zookeeper" and livy.server.recovery.state-store.url to zookeeper quorum. This PR mainly concerns the leader election part for the active-passive Livy Server.

How do the clients know the latest active node? Do they need to ask apache curator? If so, do we need to update the client code?
When people use a restful client(e.g. curl) to communicate with Livy, should they query zk every time?

#189 implements Livy Server discovery to provide the ability to get current Livy Server address by client to use it in REST requests. There is Java/Scala API for it. If someone uses not Java world client then he should ask ZK to get the address.

Another solution is we can put all active/standby services behind a load balancer. The client only needs to communicate with that load balancer. Then there's no need to change the client-side code. The server switch should be transparent to the client.

Can someone help get this feature approved and checked in?
@jerryshao

How do you do state transfer from old server to newly elected  livy server? How do you do server discovery? How do you do session recovery? I was wondering such a simple solution is good enough. Also there's no UT and IT for the code, I don't think it is ready to merge.

State transfer and session recovery are handled by the pre-existing livy.server.recovery.mode and livy.server.recovery.state-store components, provided they are configured to a Zookeeper instance.
Server discovery is decentralized though, would it be better to have an explicit configuration? I feel like having that wouldn't give any user-side benefits, given that there is no external command line tool to check the status of Livy instances.

Livy HA with redirection:
In this pull request we are adding Active/Standby High Availability (HA) to Livy Server. The goal of HA is to ensure that amoung a group of Livy Servers, only 1 is Active at
any given time while the others are on Standby. Our changes are as following:
Leveraging Zookeeper to handle Leader Election:
In order to achieve HA, we need a service to handle keeping track of the current leader. To do this, we created a CuratorElectorService class which will register the Livy Server
instance into the Leader election group and keep track of the leader. This class leverages the Apache Curator LeaderLatch Library to keep track of the current leader.
This class is also responsible for restarting the Livy Webserver when it transitions from Standby state to Active. This restart is where the Livy Webserver performs session recovery.
Redirecting to the active webserver:
With the CuratorElectorService class, Livy Server can now determine whether it is Active or on Standby. If it is active, it proceeds as usual. However, if it is on standby, it will
use the configuration in livy.conf to determine the endpoint to redirect the request to.
Creating configurations to enable HA:
We added user configurations to enable HA. These include specifying whether or not HA is enabled, the endpoints of the Livy Server instances used for HA, and the zookeeper instances
used for leader election.
Splitting Livy's start() function to init() and start():
Currently, Livy's start() function is overloaded to both initalize all of its components (the webserver, its servlets, and session managers) and then safely start them. This PR
separates the start() function into an init() component and a start() components. This is to allow us to restart the session managers and trigger session recovery without having
to safely tear down and rebuild the Livy Webserver every time.
@jerryshao can I get some eyes for a code review/suggestions?

@jerryshao small ping for a review

@jerryshao Another ping

@jerryshao pinging again

@jerryshao another ping

@jerryshao

@jerryshao

@jerryshao

Taking over the pull request with @RogPodge 's permission. A bug involving query omission on failover was fixed, along with a bit of minor refactoring and renaming.
I'm not too familiar with the code review structure of this repo, but can someone take a look at the PR and its changes? (Pinging @jerryshao based on prior messages as well)


ARROW-15426: [C++][Gandiva] Update InExpressionNode validation

Update the validation so that the type of the constant values can be specified independently of c_type of the value.

@pravindra Can you merge this?


Remote extension host terminates unexpectedly

Type: Bug
I am remote SSHing into a Linux server from a Windows machine using VSCode. I have the pylance extension, but as soon as I login to the server it restarts the remote extension host several times before giving up and occasionally kicking me out of the server. I used the extension bisect tool in VSCode, which determined that pylance was the cause. Disabling the extension fixes the problem. I have also tried downgrading the extension which has allowed me to remain connected for slightly longer, but not forever. (Apologies if this is not descriptive enough, I am happy to supply more information.)
Extension version: 2024.5.1
VS Code version: Code 1.89.0 (b58957e67ee1e712cebf466b995adf4c5307b2bd, 2024-05-01T02:09:22.859Z)
OS version: Windows_NT x64 10.0.22631
Modes:
Connection to 'ssh-remote+ap2002.chtc.wisc.edu' could not be established

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz (8 x 1992)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: enabled_ondirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_graphite: disabled_offvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: enabled

Load (avg)
undefined

Memory (System)
15.88GB (2.88GB free)

Process Argv
--crash-reporter-id d100a373-6af0-4ce5-92e5-3770ea91b189

Screen Reader
no

VM
0%

Connection to 'ssh-remote+ap2002.chtc.wisc.edu' could not be established

A/B Experiments
vsliv368cf:30146710
vspor879:30202332
vspor708:30202333
vspor363:30204092
tftest:31042121
vscorecescf:30445987
vscod805cf:30301675
binariesv615:30325510
vsaa593cf:30376535
py29gd2263:31024239
c4g48928:30535728
azure-dev_surveyone:30548225
962ge761:30959799
pythongtdpath:30769146
welcomedialogc:30910334
pythonidxpt:30866567
pythonnoceb:30805159
asynctok:30898717
pythontestfixt:30902429
pythonregdiag2:30936856
pyreplss1:30897532
pythonmypyd1:30879173
pythoncet0:30885854
2e7ec940:31000449
pythontbext0:30879054
accentitlementst:30995554
dsvsc016:30899300
dsvsc017:30899301
dsvsc018:30899302
cppperfnew:31000557
dsvsc020:30976470
pythonait:31006305
dsvsc021:30996838
g316j359:31013175
a69g1124:31038041
pythonprt:31039817
dwnewjupytercf:31039676

Can you provide us some logs as described in the troubleshooting guide?

Can you provide us some logs as described in the troubleshooting guide?

I tried to enable the trace log level (at the User, Remote Server, and Workspace levels) but the Python Language Server output contains nothing at all. Is there another log I can provide that would contain the needed information?

When you say "contains nothing at all", do you mean there's no output at all in the Python Language Server output? Not sure how could that happen. Can you share a screenshot of that? and your settings.json?

When you say "contains nothing at all", do you mean there's no output at all in the Python Language Server output? Not sure how could that happen. Can you share a screenshot of that? and your settings.json?

Here is a screenshot of the Python Language Server output:

And here is a screenshot of the Python output just to show that this is not a more general output problem:

Here is the text of the settings.json file:
{
    "editor.minimap.enabled": false,
    "jupyter.askForKernelRestart": false,
    "python.autoComplete.extraPaths": [],
    "python.analysis.extraPaths": [],
    "remote.SSH.remotePlatform": {
        "ap2002.chtc.wisc.edu": "linux"
    },
    "python.defaultInterpreterPath": "C:\\ProgramData\\anaconda3\\envs\\<USER'S NAME>\\python.exe",
    "git.ignoreLegacyWarning": true,
    "remote.SSH.useExecServer": false,
    "python.analysis.logLevel": "Trace",
    "python.analysis.packageIndexDepths": [
        {
            "name": "sklearn",
            "depth": 2
        },
        {
            "name": "matplotlib",
            "depth": 2
        },
        {
            "name": "scipy",
            "depth": 2
        },
        {
            "name": "django",
            "depth": 2
        },
        {
            "name": "flask",
            "depth": 2
        },
        {
            "name": "fastapi",
            "depth": 2
        }
    ]
}

if you are using remote and multi root workspace, make sure you are putting settings in right place and share the right setting files.
you should have settings section similar to this for your remote/workspace/folder

the precedence of setting will be
folder > workspace > remote
and some setting can only applied to certain scope. for example, you can't put logLevel to folder but in workspace and up and etc.

since it looks like pylance is crashing even before starting server, you probably can't use https://github.com/microsoft/pylance-release/wiki/Collecting-data-for-an-investigation.#collecting-trace-logs-using-commands but if you somehow could manage to make server to start you could use the command to get log we need.

if you are using remote and multi root workspace, make sure you are putting settings in right place and share the right setting files.
you should have settings section similar to this for your remote/workspace/folder
the precedence of setting will be folder > workspace > remote
and some setting can only applied to certain scope. for example, you can't put logLevel to folder but in workspace and up and etc.

I have set the loglevel setting to Trace at the User, Remote, and Workspace levels just to make sure I had the right one. The Folder option does not have this setting available as far as I can tell.

since it looks like pylance is crashing even before starting server, you probably can't use https://github.com/microsoft/pylance-release/wiki/Collecting-data-for-an-investigation.#collecting-trace-logs-using-commands but if you somehow could manage to make server to start you could use the command to get log we need.

I have used slightly downgraded versions of pylance recently that will successfully load/connect for a while before restarting the remote extension host. I just connected with v2024.2.3 and was able to get output in the Python Language Server. I will wait to see if the restart issue occurs and report back with the output.

I can not see any issue on pylance log, it looks like pylance extension suddenly restarted. can you look other logs in the output window and see whether it contains error message such as remote got disconnected? if you see one, can you share that log with us? it might be an issue with vscode remote and we just happen to restarted since vscode-server got re-initialized.

I can not see any issue on pylance log, it looks like pylance extension suddenly restarted. can you look other logs in the output window and see whether it contains error message such as remote got disconnected? if you see one, can you share that log with us? it might be an issue with vscode remote and we just happen to restarted since vscode-server got re-initialized.

I monitored a couple of the logs while trying to recreate the issue, but I could not seem to identify any that would provide useful information as to what is happening. Here is the list of logs available:

For example, Extension Host (Remote) seemed promising, but it appears to clear/restart whenever this occurs, so I cannot see what happened prior to the issue occurring.
Are there any you would like to see specifically?

how about remote - SSH log? does it contain anything interesting there?

how about remote - SSH log? does it contain anything interesting there?

Nothing is very interesting in that log either. For example, here is all the additional output produced by this issue occurring once:
[16:17:13.840] [Forwarding server port 52873] Got connection 9
The integer at the end increases every time this happens (starts at 1).

could it be something related to something like this? https://stackoverflow.com/questions/64172004/vscode-ssh-extension-keeps-disconnecting-after-moving-to-a-new-location

could it be something related to something like this? https://stackoverflow.com/questions/64172004/vscode-ssh-extension-keeps-disconnecting-after-moving-to-a-new-location

I tried the suggested solution of removing the .vscode-server and .vscode-remote (this second one did not exist in my case, so I only removed the first one), but it did not fix the issue. The Remote Extension host still terminates upon logging in via ssh when using the most recent version of pylance.


Use Microsoft.Generator.CSharp.Input project for input types

MGC has a project to hold the input types: Microsoft.Generator.CSharp.Input
We could use this project for the input types so that we do not have to apply the code change on both sides.

Duplicated with https://github.com/Azure/azure-sdk-for-net/issues/45740, close this one.


[Bug]: Two dffrent pages in one

What happened?
I've updated my LoRA not so long ago and then got a strange bug for all people, who's opening LoRA's page and for myself.
When you're updating it's page with F5 or just browsing civitai, you're getting two different page versions. Old one and new one. I have no idea what happened. Or it just dissapears from search and my profile. Also affected by F5 and any page update.
As you can see, there is also diffrent likes conter.
Steps to reproduce the problem

Go to https://civitai.com/models/11034
Press F5 several times (it always random)
Behold!

This two pages are located in one LoRA page above, on the same link.

What should have happened?
There should be only one page (NEW)
This ->

What platforms do you use to access the site?
Windows
What browsers do you use to access the site?
No response
Additional information, context and logs
The same effect on any browser. I've got several reports from many people.

A small update: some people just can't see LoRA's page in browser or in my profile. But somehow new version got 43 downloads.


use unityci/editor for gitlab manual activation

Changes

gazunk — Today at 6:06 AM
Hi, thanks for the response. https://game.ci/docs/gitlab/activation still mentions gableroux images, and segfaults for me.

image now pointing to unityci/editor :)
Checklist

[x] Read the contribution guide and accept the code of conduct
[x] Readme (updated or not needed)
[x] Tests (added, updated or not needed)

Closing in favor of https://github.com/game-ci/documentation/pull/144
I'll propose changes, I did miss the unity's path.


Fix animated player

The animated player was not facing in the correct direction. I moved the animation-concerning pieces out of the Player class into LivingEntity so that it now either flips the texture if the drawable is a TextureDrawable or sets the animation type if it is a AnimationDrawable.

I noticed this bug too. Thanks for fixing it!


Create BakeAnnotationClasses direction for English Composition

Paragraphs with annotation classes  present in English Composition need to be supported in Kitchen. Corresponding recipes PR: https://github.com/openstax/recipes/pull/69
Screenshot showing differences between cnx-recipes and kitchen baked output file for such paragraphs:

Related cnx-recipes issue that needs to be checked out in Kitchen: https://github.com/openstax/cnx-recipes/issues/4015


feat: Implement user notification retrieval with authentication

Description
This update adds authentication to the /api/v1/notifications/current-user endpoint. The endpoint retrieves notifications for the currently authenticated user. If the user is not authenticated, it returns a 401 Unauthorized response.
How Has This Been Tested?

Unit Tests:

Implemented unit tests for the new authentication logic using Pytest.
Verified that only authenticated users can access their notifications.

Postman:

Created and tested requests in Postman.
Below are the screenshots of the successful tests:

Types of Changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist

[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.

How to Run and Test the Project
Prerequisites
Ensure you have the following installed on your machine:

Python 3.10
PostgreSQL
Git
Virtualenv (optional but recommended)

Setup Instructions

Clone the Repository
git clone <repository_url>
cd <repository_directory>

Create and Activate a Virtual Environment (optional but recommended)
python -m venv .venv
source .venv/bin/activate  # On Windows use `.venv\Scripts\activate`

Install Dependencies
pip install -r requirements.txt

Configure Environment Variables
Create a .env file in the root directory and add the following environment variables:
DB_HOST=aws-0-eu-central-1.pooler.supabase.com
DB_PORT=6543
DB_USER=postgres.tdskwjrpthyrsvdksdlv
DB_PASSWORD=sVc9LMRvp.bdc$V
DB_NAME=postgres
DB_TYPE=postgresql
SECRET_KEY=your_secret_key  # Replace with your secret key

Run Database Migrations
alembic upgrade head

Start the FastAPI Server
uvicorn main:app --reload

The server will start at http://<IP_ADDRESS>:8000.

Testing Instructions

Run Unit Tests with Pytest
pytest

This will run all the test cases and provide a report of the test results.

Testing with Postman

Generate a JWT Token for Authentication

You can use the /auth/login endpoint with valid user credentials to obtain a JWT token.

Example request:
POST /auth/login
{
    "username": "your_username",
    "password": "your_password"
}

Copy the token from the response.

Test the Notifications Endpoint

Open Postman and create a new GET request to http://<IP_ADDRESS>:8000/api/v1/notifications/current-user.
In the Headers section, add:Authorization: Bearer <your_jwt_token>

Send the request.
You should receive a response indicating the notifications for the authenticated user:{
    "success": true,
    "status_code": 200,
    "data": [
        {
            "id": 1,
            "user_id": 12345,
            "message": "Your notification message",
            "read_status": false,
            "created_at": "2024-07-23T18:25:43.511Z",
            "updated_at": "2024-07-23T18:25:43.511Z"
        }
    ]
}

Notes

Ensure your PostgreSQL database is running and accessible with the credentials provided in the .env file.
If you encounter any issues, please check the logs for detailed error messages and verify that all dependencies are correctly installed.

CI is failing


cant download the go pow

[14:33:00] [GOldDggr]  [INF] downloading pow_win_amd64_v2.exe from https://github.com/mikrohash/isf-jclient/releases/download/v1.0.9/pow_win_amd64_v2.exe ...
[14:33:01] [GOldDggr]  [WRN] unfortunately, the go pow module for your system (Windows 10, amd64) is not available. Please contact us via<EMAIL_ADDRESS>so we can add it to our collection. If you want to compile it yourself, you will find instructions in the README.md
[14:33:01] [GOldDggr]  [ERR] could not download go pow module, will use low-performing java pow module instead
the problem is, i dont even have an amd.

That's weird. It's what your Working Environment says:
System.getProperty("os.arch")

Going to check what other ways there are to determine the architecture.

last build i used was 1.0.3

AMD64 is just what is used to describe 64 bit systems, even if you have an Intel CPU it will say AMD64. It's essentially the same instruction set.
On to the main point, I'm not able to download v2 of pow_win_amd64 either and I've tried to compile it from the GIOTA library but have failed many times /shrug

you should be able to download the go pow module for your system now


Upgrade to Windows SDK 22000

Upgrades our SDK from 19041 (Windows 10 20H1) to 22000 (Windows 11 RTM).
The newer SDK is supposedly more compatible with /Zc:preprocessor
and will allow us to use newer Windows 11 APIs directly.
PR Checklist

[x] I work here
[x] Tests added/passed

Validation Steps Performed

Compiles ✔
Runs ✔

I've asked for the Windows SDK 22000 changelogs internally, but unfortunately no one ever replied.
Because we got this funny little stint going on where you click here:

And you're lead here:

Until then I guess we just gotta assume that the system requirements are at least correct because those say:

UWP: Windows 10 version 1507 or higher
Win32: Windows 7 SP1 or higher

It seems like those projects also use cppwinrt.build.pre.props, so it should work fine.


Handled exception when settings table not created

Fixes #72
I had to do a janky str_contains because prepare() calls are hidden from the User class.
TL;DR: moved creating the settings table into a method, called it if the table doesn't exist.
Also updated the "Error connecting to DB" message because I just had quick hands. :~)

Not needed. isInstalled() works good.

Not needed. isInstalled() works good.


Disable custom bar

Hello, i just installed your theme from the spicetify marketplace, and was wondering if there was a toggle for the custom player bar but couldn't find any, it would be a nice option for someone like me that like to stick with the default spotify bar. thank you in advance :)

I doubt this is something we can consider I'm afraid, I'll give it a shot and see if it affects any other parts of the theme which it is highly likely it might.
If it doesn't effect anything else (eg we wouldn't have to consider this option any time we want to implement something new), then I'd be happy too.
I'll keep you posted!

perfect, thank you again.


"@dependabot rebase" command recreates PR with new hash for gitsubmodule

Is there an existing issue for this?

[X] I have searched the existing issues

Package ecosystem
gitsubmodule
Package manager version
No response
Language version
No response
Manifest location and content before the Dependabot update
No response
dependabot.yml content
version: 2
updates:
  - package-ecosystem: "gitsubmodule"
    directory: "/"
    schedule:
      interval: "daily"
    open-pull-requests-limit: 10
    allow:
      - dependency-name: "OurPrivateRepo"

Updated dependency
No response
What you expected to see, versus what you actually saw
Using the above dependabot.yml we are correctly getting pull requests created to update the submodule to the latest hash of main in the specified submodule.  When a developer goes to merge the pull request, they would like to use @dependabot rebase first.  However, using that command seems to close the current PR and creates a new PR with a new hash if the submodule has more commits on main since the original PR was created.
We'd like to run our CI checks against a particular hash but then rebase the dependabot PR without picking up any new hashes in the submodule.  Is this already possible?  Bug?  I see some value in always trying to pick up the latest hash, but it wasn't what we were expecting to happen.
Native package manager behavior
No response
Images of the diff or a link to the PR, issue, or logs
No response
Smallest manifest that reproduces the issue
No response

I get where you're coming from, but I don't think @dependabot rebase is the right move here.
Under the covers @dependabot rebase is re-running the job, and not limiting itself to only the current version--it looks for an updated version. I realize this is a bit non-intuitive, and I'm sorry about that.
Are two alternatives are changing the behavior so that it doesn't bump the version, but only recreates the PR... while doable, that is a bit of work technically since there's edge cases of what if the new base no longer is compatible with this version etc. So we'd likely end up with a third command, which adds user confusion (they're already often confused on rebase vs recreate.) Alternatively, we could rename the command, and that may long-term be a better solution to move away from confusion with a normal git rebase... But that's also a larger discussion.
Also, your use case makes sense to me, but it's by far the minority use case... anecdotally it seems its much more common that users want the dep updated if a new one was released.
So long term we should work to reduce confusion on the naming, but regardless any changes are unlikely to result in the behavior you're asking for here.
So I'm afraid I'm going to close for now. If over time we continue to get this request from others, then we can re-evaluate, but I don't recall ever hearing it before.

No worries. Thanks for the information and clarification.  We were already talking about ways to change how we handled it but wanted to raise the question since our expectation was different from how it worked.


chore: update dep injective-std

Instead of this, we should publish a new version from latest branch once the chain upgrade is done


Enable the dashboard on the home page

Edit: Do Not Merge yet
I also added some integration tests.

This should be good to go now 👍


Pointers to Objects in Cpp

Description
Description
Domain
C/CPP
Type of Contribution
Documentation
Code of Conduct

[X] I follow Contributing Guidelines & Code of conduct of this project.

/assign


Added Kloudle info

Added links for Kloudle website, LinkedIn and Crunchbase.
Thanks for creating this list.

We had already added Kloudle to the list, sorry our contributions crossed, thank you either way though!


start a git mergetool help section

Not finished. Just getting started.
Mentioned in #58.

We have "You will probably encounter merge conflicts, in which your system's git merge tool will run." in there now.


heishamon together with home-assistant-aquarea

** Versions **

Home Assistant version 2024.6.4
This integration version 1.9.1

I just wanna use your heishamon integration together with home-assistant-aquarea integration (https://github.com/cjaliaga/home-assistant-aquarea). but looks like both integrations uses the same configuration folder named "aquarea" in HA. when you install second integration, first one get overwritten..
can you please change this config folder name to something like "heishamon", or provide and instruction how i can change it manually in HomeAssistant?
Thanks,
Uldis

Hello,
manually you can rename the folder to heishamon and it should work. You'll need to make this change whenever you want to update the integration.

Hello!
see my post also here: https://community.home-assistant.io/t/panasonic-aquarea-heat-pump-integration/392095/199?u=uldise
i tried steps with renaming folder, but got an exception on loading integration. so looks like there is another place i should change?

I think hacs has a reference to the directory where it installed an integration.
One possible way to deal with this would (untested):

remove the integration with hacs
install it manually (downloading the release yourself and renaming the directory)
editing https://github.com/kamaradclimber/heishamon-homeassistant/blob/main/custom_components/aquarea/manifest.json to put the correct domain

I don't think there is a need to change all reference to aquarea in the code.
Downside of this approach is that you won't be aware of new versions of the integration (but the integration is pretty much feature complete).

see my comment here: https://github.com/cjaliaga/home-assistant-aquarea/issues/115#issuecomment-2239833967


TypeError: Promise.withResolvers is not a function

From an off comment in https://github.com/ai16z/eliza/issues/47#issuecomment-2443482858 from https://github.com/adnanmirza1
Describe the bug
Hello @sirkitree, hope you'll be fine. Sorry for being off the topic but I need help setting up this project on my linux machine, I added env's, node v 20.13.1, runned npm i which was successful, and now after node --loader ts-node/esm src/index.ts
I'm seeing below error.

@adnanmirza1 can you please add step to reproduce this bug reliably?

I'm now experiencing this.
This error occurs because Promise.withResolvers() is a relatively new feature that isn't available in Node.js v20.18.0.
We have a few options to fix this:

Upgrade to Node.js v21.0.0 or later where Promise.withResolvers() is supported
Use an older version of pdfjs-dist that doesn't use this feature.
Create a polyfill for Promise.withResolvers(). You would need to add this before importing pdfjs-dist.

I think we should go with option 1.
Thoughts @lalalune ?

I'm now experiencing this.
This error occurs because Promise.withResolvers() is a relatively new feature that isn't available in Node.js v20.18.0.
We have a few options to fix this:

Upgrade to Node.js v21.0.0 or later where Promise.withResolvers() is supported
Use an older version of pdfjs-dist that doesn't use this feature. You can modify your package.json
Create a polyfill for Promise.withResolvers(). You would need to add this before importing pdfjs-dist

I think we should go with option 1.

Tested this PR and it works - do you want to give it a shot @adnanmirza1 ?

thanks @sirkitree, I just cloned it followed the steps from readme, installed the packages using npm i, (node version 20.13.1).
After this I started the project using command npm run start and got this Promise.withResolvers error.
I did some search and added polyfill and the issue was solved using the guides from issue
https://github.com/wojtekmaj/react-pdf/issues/1811
then after some time I simply updated the node version to 22.10.0 using nvm and the issue was solved even without the polyfill.


Conda build prepare

This PR makes use of conda-build-prepare

The conflict is there as we need to add litex-hub/label/travis-$branch-$TRAVIS_BUILD_ID as a temp branch - not a big issue

Conflicts?

As i commented above, should be easily fixable , just need to find a moment for that

All CIs green:

https://travis-ci.com/github/litex-hub/litex-conda-misc/builds/205697261
https://travis-ci.com/github/litex-hub/litex-conda-prog/builds/205697033
https://travis-ci.com/github/litex-hub/litex-conda-compilers/builds/205697501
https://travis-ci.com/github/litex-hub/litex-conda-eda/builds/205869144

We are green on all repos, let's merge


bindActionCreator dispatch error "undefined is not a function"

undefined is not a function( evaluating 'dispatch(actionCreator.apply(undefined,arguments))')
This is showing when i am submitting event that is connected to bindActionCreators.
error image that is taken in android phone https://drive.google.com/file/d/0B4w19o4gcjmiSWZMSnRITkY3dVk/view?usp=drivesdk

This is a bug tracker, not a support system. For usage questions, please use Stack Overflow or Reactiflux where there are a lot more people ready to help you out. Thanks!


Fix/defender shared mqtt

Description

Checklist:

[ ] I have tested my changes. No regression in existing tests.
[ ] My code is Linted.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Will create another pull request after sync to master.


how to add remove array by object key?

I have state (reactive object) like this
var state = new ReactiveObj({items: []});
state.push('items', [{id: 1, qty: 10}]);
state.push('items', [{id: 2, name: 15}]);

And then I want to remove array that {id: 1}
Please help me.

If id is unique, you can use a linear search in the array and remove it using array.splice.
// _.find from underscore
_.find(state.get('items'), function (v, i) {
  // Remove first instance where id is 1
  if (v && v[0] && v[0].id === 1) {
    state.splice('items', i, 1);
    return true;
  }
});

Very thanks, I will try

Closing this for now.


TIKA-2447 reduce memory consumption of PSDParser

Thanks for this! Unfortunately it breaks the unit tests as it stands, because stream.skip may not skip the whole amount... I've committed a slightly modified version

Thanks for this fast apply of that patch. You should also close the jira ticket.

I've tested the code. To protect us against too large files we crop them.
This now causes the file to unlimeted skip, because it can't skip behind the cropped end of the file.
This is caused by the implementation of skipFully which tries to skip if even there is nothing to skip.
Unlike read, skip will not return -1 if EOF is reached!

Any thoughts on how we should patch skipFully to handle it? Maybe check if skip returns 0, then call a read to see if it's -1?

there is a bug report in poi: https://bz.apache.org/bugzilla/show_bug.cgi?id=61294

and it is fixed with https://github.com/apache/poi/commit/c7db66a30dfb6cbbd5812ff3ae4c90ed2d9b9a27

@Gagravarr thank you for taking this!  @bjrke thank you for opening this and submitting a PR!  I'm just back from vacation...sorry for not contributing, is there anything that needs to be done on this?

no, only release of a new version of poi and tika :)


Wish: simulating water/ice/rock propagation (with different water models)

Hi again!
is there any plan on including water/ice/rock propagation? This would be really great for systematic studies for a number of experiments (although my guess is it may not be so simple).

Hi.
Well, it is actually already there but somewhat unfinished and not fully debugged. There is a density class called GeneralizedTarget. This gives you a 1D target with piece-wise homogeneous media.
This may be numerically unstable and needs sometimes a bit of fiddling mainly because I have no time to properly debug it. There are even people using this.
To switch to one of these media ['air', 'standard_rock', 'ice', 'water'], look at line 368 in data.py. These are dEdX tables from PDG. I had no time yet to make a user iface. If you think a config variable will do the job, let me know or feel free to propose something. If you compute also hadronic cascades and not just muons, you need to adjust A_target in the config and preferably not deviate much from 14 since the interaction tables are for air (but dependence is relatively weak).
Look at the attached jupyter notebook for how to interact with this feature. You should definitely compare this with some kind of benchmark calculation or a different code, for instance PROPOSAL Please let me know about the results, positive or negative, since I have no idea.
ArbitraryDensityPrototype.zip

Thanks, will have a look!

Hmm, when I execute ad.draw_materials() in your jupyter notebook it does not display a plot :< Do I need %run -i "../../initjupyter_ng.py" for this?

That's a remnant of my dev environment. There are just basic settings and imports. Replace it with
# %run -i "../../initjupyter_ng.py"
import numpy as np
%matplotlib inline
import mceq_config as config
from MCEq.core import MCEqRun
import crflux.models as pm
import matplotlib.pyplot as plt

The notebook works, however by the similar logic as in the muon bundles issue, I drop this for now.

FYI, I've tested this notebook with MCEq v1.6 and the ratio of muon spectrum to the one at the surface seems not to produce the same result anymore.
plot from your notebook:

what I get running the same code:

Hi! Could you please share some pieces of your code? What are we looking at here?

Ah, tried now to reproduce from scratch from your ArbitraryDensityPrototype.ipynb notebook and when I just add missing imports I do get the same plot, must have modified something else when playing with things. Sorry for the false alarm 🙈. I wanted to try to evaluate muon and neutron fluxes in two underground mines, but I was getting strange results... I might produce a comparison with something else at some point as a cross-check, will post it here for reference.

Glad to hear. But good that you mention that you want to compute underground labs. If these labs are deep, i.e. X > 1 kmwe then the MCEq propagation is not going to return accurate results. There are some technical reasons behind it, which are not relevant for X < 100000 g/cm2 but become relevant for larger depth. You may want to consider using the code MUTE, which makes use of MCEq at the surface and then does some convolutions to calculate the underground or underwater fluxes.

Oh, basically MCEq + PROPOSAL, I see :)

Thanks for the recommendation @afedynitch, MUTE was exactly what I needed :)


"Undefined constant 'JeroenNoten\LaravelAdminLte\Helpers\LayoutHelper' (View: C:\laragon\www\kors\vendor\jeroennoten\laravel-adminlte\resources\views\page.blade.php)"

|After installing the ADMINLTE package, I get the following error when I want to use it in any view
"Undefined constant 'JeroenNoten \ LaravelAdminLte \ Helpers \ LayoutHelper' (View: C: \ laragon \ www \ kors \ vendor \ jeroennoten \ laravel-adminlte \ resources \ views \ page.blade.php)"
What could it be ?, Until yesterday it worked perfect for me

@ferchivilcoy I have also notice this, I will upload a PR soon for this issue. What version of Laravel are you running? In my particular case this happens after updating laravel/framework to 8.29.0.

Today I did a new Laravel installation and I have 8.29.0 too. We will have to wait for that bug to be corrected..

same error for my use laravel 8.12

I just did a clean install and this error occurs. Sad.

I managed to solve the problem, but I don't know how much is correct.
My solution is in the files :

resources/views/vendor/adminlte/partials/sidebar/menu-item.blade.php
resources/views/vendor/adminlte/partials/navbar/menu-item.blade.php

I refactor @inject('menuItemHelper', '\JeroenNoten\LaravelAdminLte\Helpers\MenuItemHelper')
and all files, where strict this error
because name space  \JeroenNoten\LaravelAdminLte\Helpers\MenuItemHelper you need to enclose it in quotation marks
sees an undefined constant, instead of the path to the helper
I hope this helps you

Alex0Fury
I tried to do what you say, but it still doesn't work ..

 To manually solve this issue (while waiting for a new release) check PR #813 to see what files you need to change.
If you have plublished the views then you need to edit files inside resources/views/vendor/adminlte/.
Otherwise you need to edit files in vendor/jeroennoten/laravel-adminlte/resources/views/.
Paths are relative to your Laravel project.

Important: After the new release, you will need to manually update the views you have previously published (if this is your case).

The fix was released with v3.5.3.

This helps to solve that, but idk if it´s because of this that a "bug" happens, it's just that if one of your sidebar options has two words it disappears.

@DesarrolloProm The solved issue was about injecting a service into the blade views, should not be related to your problem. I will check your configuration to see if I can reproduce the problem.

@DesarrolloProm Can't reproduce your issue. Please, consider opening a new issue adding all the information to reproduce the issue, like:

The complete menu configuration on adminlte.php file.
The locale you are using (this is configured on the laravel file config/app.php).
The package translation files for the locale setup. For example resources/lang/vendor/adminlte/en/ if locale is configured to en.
Other data you consider is important.

@Shidersz I just rewrite the options names and everything's fine again, maybe it's just something on my cpanel or hosting idk.

Could you please also merge the fix into the next branch?

The fix was released with v3.5.3.

The problem wasn't fixed in vendor/jeroennoten/laravel-adminlte/resources/views/partials/common/brand-logo-xl.blade.php.

@Puduru thank you for your feedback. A Pull Request was created for it...

I got this after $ composer update, any solution
Error
Undefined constant "JeroenNoten\LaravelAdminLte\Helpers\LayoutHelper" (View: C:\xampp\htdocs\codersfree\resources\views\vendor\adminlte\page.blade.php)

@Dev96xp Please provide us with more details like version of this plugin & laravel version. Thank you.

I have the same error message:
lluminate\View\ViewException · Undefined constant 'JeroenNoten\LaravelAdminLte\Helpers\LayoutHelper' (View: /home/forge/xxx/resources/views/vendor/adminlte/page.blade.php) (View: /home/forge/xxx/resources/views/vendor/adminlte/page.blade.php)

Laravel Version: v8.76.2
Laravel Adminlte Version: v3.7.2

Try running artisan view:clear

Try running artisan view:clear

Didn't work for me. Tried also to clear cache etc. and upgraded to version v3.7.3

Everything was working fine, until I did the composer update ($ composer update), once I finished, I tried to enter my app, where I use LTEADMIN, it won't let me enter anymore and I get this error.
Error
Undefined constant "JeroenNoten\LaravelAdminLte\Helpers\LayoutHelper" (View: C:\xampp\htdocs\codersfree\resources\views\vendor\adminlte\page.blade.php)
I have this:
$ php artisan --version
Laravel Framework 8.82.0

@lukaskukla @Dev96xp Your problem is mainly because you have published the views but you have never updated they. I recommend to to compare folders resources/views/vendor/adminlte with vendor/jeroennoten/laravel-adminlte/resources/views/ and add all the changes you see on the second one to the first one. You may also follow the update procedure mentioned on the Wiki pages (check step 3).

OMG,..Works..Thank you very much, work, I made the backups of those two folders and then execute the command from step 3, which you sent me and work is fixed, thank you very much !!!
I backup these

and

$ php artisan adminlte:install --only=main_views --force
@lukaskukla thank you very much !!!

Diego Smania, thank you so much<EMAIL_ADDRESS>

@Shidersz, Thank you so much for your help!

@Shidersz,
I just found that this button does not work, I press it and it does absolutely nothing, it is inside a livewire component, I had not touched it at all but it works perfectly I don't know if it is related to the previous error, any solution in mind?

thank you.

I just realized that my livewire components stopped working inside Laravel-AdminLTE, I try these components on other pages and they work fine, any suggestion, this happened after I resolved the above error from: (JeroenNoten\LaravelAdminLte....)  thank you.

@Dev96xp Should not be related to the previous problem, make a comparison between your backups views and the ones currently published. Maybe you made a custom change on the past...


refactor(window): Update Window API to differentiate between scaled/unscaled sizes

Motivated by https://github.com/onivim/oni2/pull/1752 - this addresses an inconsistency in the Revery Window API in talking about sizes - there are two window sizes that SDL gives us - the 'screen space' size, and the 'framebuffer' size. On top of that, we also account for display scaling (like frameworks like Electron handle). So that makes three 'spaces' for window sizes:

Screen space size
Screen space size, scaled based on display settings
Framebuffer pixel size (the size of the 'backbuffer' that we render to - this is in pixels can vary depending on the device pixel ratio of the screen. For example, retina displays would be some multiple of the screen space size).

For the purposes of window management, we only care about 1 & 2 - framebuffer size is important for rendering though.
We run into case 2 in Linux with GDK_SCALE applied, or zoomed display settings on Windows. When the scaleFactor is 1, cases 1/2 are equivalent.
The problem was, the API surface wasn't consistent in handling scaling - create, getSize, and setSize should all be consistent in the space they use - which they weren't. create would use coordinates in the 'display scaled' space (2), but getSize/getRawSize would get the dimensions in unscaled space (1) - and setSize would also retrieve dimensions in unscaled space. This is confusing and inconsistent, and caused problems in https://github.com/onivim/oni2/pull/1752, because we'd use getSize to read the window dimensions (without scaling applied), and then on startup we'd apply scaling to them, causing the window to grow in size, because each create would re-apply scaling.
TODO:

[x] Test on Linux with GDK_SCALE set
[x] Test on retina OSX display
[x] Test on non-retina OSX display
[x] Test on unscaled Windows display
[x] Test on Windows display with display scaling
(test example app, example with zoom, Onivim 2 text rendering, Onivim 2 persistence round trip)

Tested across platforms with scaling - looks like everything is still good 👍


Consider making toolbar more prominent

Feedback by Nick Duffield: Could not find where I can turn a paragraph into a heading.

Think this now works better in the new design.


Endless loop on WARNING: Failed to download song. Will retry after other songs

What is the purpose of your issue?

[x] Bug
[ ] Feature Request
[ ] Question
[ ] Other

Description
Downloading a playlist first songs can be downloaded properly but at some point I encounter this error and the script stay in an endless loop on this error.
I have installed from pip and use latest python version.
Log
ERROR: _warn() takes 2 positional arguments but 5 were given
    Traceback (most recent call last):
      File "d:\programs\python\lib\site-packages\spotdl\downloader.py", line 207, in _download_list
        track_dl = Downloader(raw_song, number=number)
      File "d:\programs\python\lib\site-packages\spotdl\downloader.py", line 98, in __init__
        self.content, self.meta_tags = youtube_tools.match_video_and_metadata(raw_song)
      File "d:\programs\python\lib\site-packages\spotdl\youtube_tools.py", line 79, in match_video_and_metadata
        meta_tags = spotify_tools.generate_metadata(track)
      File "d:\programs\python\lib\site-packages\spotdl\spotify_tools.py", line 34, in wrapper
        return func(*args, **kwargs)
      File "d:\programs\python\lib\site-packages\spotdl\spotify_tools.py", line 48, in generate_metadata
        meta_tags = spotify.track(raw_song)
      File "d:\programs\python\lib\site-packages\spotipy\client.py", line 222, in track
        trid = self._get_id('track', track_id)
      File "d:\programs\python\lib\site-packages\spotipy\client.py", line 850, in _get_id
        type, fields[-2], id)
    TypeError: _warn() takes 2 positional arguments but 5 were given
WARNING: Failed to download song. Will retry after other songs

Please search existing issues before posting a new one, otherwise this is just a waste of time for everyone.
As I said before, put tracebacks and console output in general in code blocks.

I have looked at the 4 related issues. I thought it is another one since for me the error happens after some download was successful. and my error message looks sthg different. Can you maybe point to the issue you think it is a duplicate of?

It is a bit of a pain to rerun the download of a big playlist with DEBUG LOG so I would be grateful if you can start thinking of potential bug source with the error output I have provided.

That'd be a few more than 4: https://github.com/ritiek/spotify-downloader/issues?utf8=✓&q=is%3Aissue+Failed+to+download+song.+Will+retry+after+other+songs
For starters you should provide the exact command you ran so we can either reproduce and possibly fix or not reproduce this.

I have updated the description with the 2 lines of command so you can try to reproduce.

When entering the error description at issue create github only display the related issues matching by their title/ description and not the body, This is why I had much less than your link shows.

I cannot reproduce the error, see the log below.
➜  ~ mkdir spotdl_test
➜  ~ spotdl --playlist open.spotify.com/playlist/3vwnLEqq2oR5aucDxpTQEO
INFO: Writing 38 tracks to star-flasch.txt
➜  ~ spotdl -l star-flasch.txt -f /home/linus/spotdl_test
INFO: Checking and removing any duplicate tracks in reading star-flasch.txt
INFO: Overriding star-flasch.txt with unique tracks
INFO: Preparing to download 38 songs

INFO: 1. DARDAN X LUCIANO - AIRMAX GEGEN KOPF (prod. by Leryk) (http://www.youtube.com/watch?v=YTHr7gxwYUQ)
  2,652,981 Bytes [100.00%] received. Rate: [7367 KB/s].  ETA: [0 secs]
INFO: Converting Dardan - Airmax gegen Kopf.m4a to mp3
INFO: Applying metadata

INFO: 2. AZET feat. RAF CAMORA - QA BONE ( LYRICS ) (http://www.youtube.com/watch?v=vjfmTiZHOUM)
  3,108,564 Bytes [100.00%] received. Rate: [9683 KB/s].  ETA: [0 secs]
INFO: Converting Azet - Qa bone.m4a to mp3
INFO: Applying metadata

INFO: 3. Capital Bra Feat. Juju - Melodien (Lyrics) (http://www.youtube.com/watch?v=_7JAXcXBeb4)
  2,514,675 Bytes [100.00%] received. Rate: [9951 KB/s].  ETA: [0 secs]
INFO: Converting Capital Bra - Melodien (feat Juju).m4a to mp3
INFO: Applying metadata

INFO: 4. ProSingKaraoke - Bonez MC and RAF Camora - 500 PS (Karaoke Version With Lyrics) (http://www.youtube.com/watch?v=iTGR70qhSPI)
  3,049,479 Bytes [100.00%] received. Rate: [7592 KB/s].  ETA: [0 secs]
INFO: Converting Bonez MC - 500 PS.m4a to mp3
INFO: Applying metadata

INFO: 5. CAPITAL BRA feat. UFO361 - NEYMAR | KARAOKE LYRICS (http://www.youtube.com/watch?v=80J1gxGVY2U)
  4,138,171 Bytes [100.00%] received. Rate: [6679 KB/s].  ETA: [0 secs]
INFO: Converting Capital Bra - Neymar.m4a to mp3
INFO: Applying metadata

INFO: 6. Micha Maat and the Rockstars - Rockmusik (http://www.youtube.com/watch?v=_rJlKUskFXk)
  2,390,789 Bytes [100.00%] received. Rate: [9938 KB/s].  ETA: [0 secs]
INFO: Converting Micha Maat - Rockmusik.m4a to mp3
INFO: Applying metadata

INFO: 7. Na Na Na (http://www.youtube.com/watch?v=E495ke3WUGY)
  3,010,050 Bytes [100.00%] received. Rate: [7428 KB/s].  ETA: [0 secs]
INFO: Converting Capital Bra - Na Na Na.m4a to mp3
INFO: Applying metadata

INFO: 8. Wie Falco (http://www.youtube.com/watch?v=CAt9tgxBcPE)
  4,097,239 Bytes [100.00%] received. Rate: [8033 KB/s].  ETA: [0 secs]
INFO: Converting Nimo - Wie Falco.m4a to mp3
INFO: Applying metadata

INFO: 9. CAPITAL BRA - Feuer (prod. Lucry) (http://www.youtube.com/watch?v=-bAv0hlF9_g)
  2,723,297 Bytes [100.00%] received. Rate: [7737 KB/s].  ETA: [0 secs]
INFO: Converting Capital Bra - Feuer.m4a to mp3
INFO: Applying metadata

INFO: 10. Loredana  SONNENBRILLE  lyrics (http://www.youtube.com/watch?v=Yd0Kg_W_pPY)
  2,570,766 Bytes [100.00%] received. Rate: [9760 KB/s].  ETA: [0 secs]
INFO: Converting Loredana - Sonnenbrille.m4a to mp3
INFO: Applying metadata

INFO: 11. Punch Arogunz - Sonnenbrille/Cappuccino (Frontal) (http://www.youtube.com/watch?v=2E_iwyoRzXE)
  3,477,856 Bytes [100.00%] received. Rate: [7579 KB/s].  ETA: [0 secs]
INFO: Converting Punch Arogunz - Sonnenbrille - Cappuccino.m4a to mp3
INFO: Applying metadata

INFO: 12. Von ihnen gelernt (http://www.youtube.com/watch?v=3BBizLrs6_8)
  3,688,969 Bytes [100.00%] received. Rate: [9858 KB/s].  ETA: [0 secs]
INFO: Converting Bonez MC - Von ihnen gelernt.m4a to mp3
INFO: Applying metadata

INFO: 13. Sido feat. Doreen - Nein (http://www.youtube.com/watch?v=FgO-63whE-I)
  3,866,711 Bytes [100.00%] received. Rate: [7747 KB/s].  ETA: [0 secs]
INFO: Converting Sido - Nein (feat Doreen).m4a to mp3
INFO: Applying metadata

INFO: 14. SDP-Tanz aus der Reihe lyrics (http://www.youtube.com/watch?v=J9zm6jDVplM)
  3,652,001 Bytes [100.00%] received. Rate: [6250 KB/s].  ETA: [0 secs]
INFO: Converting SDP - Tanz aus der Reihe.m4a to mp3
INFO: Applying metadata

INFO: 15. Bushido feat. Samra & Capital Bra - Für euch alle (lyrics) (http://www.youtube.com/watch?v=-E-a783xPUk)
  4,057,572 Bytes [100.00%] received. Rate: [8667 KB/s].  ETA: [0 secs]
INFO: Converting Bushido - Für Euch alle (feat Samra  Capital Bra).m4a to mp3
INFO: Applying metadata

INFO: 16. MERO -Baller los(lyrics) (http://www.youtube.com/watch?v=bD6TqWXbh2I)
  2,617,025 Bytes [100.00%] received. Rate: [6912 KB/s].  ETA: [0 secs]
INFO: Converting MERO - Baller los.m4a to mp3
INFO: Applying metadata

INFO: 17. MERO - WOLKE 10 / Lyrics [Original mit Stimme] (http://www.youtube.com/watch?v=uAaFsYLp7eY)
  2,828,934 Bytes [100.00%] received. Rate: [6557 KB/s].  ETA: [0 secs]
INFO: Converting MERO - Wolke 10.m4a to mp3
INFO: Applying metadata

INFO: 18. AZET ft. ZUNA - Pam Pam (Musikvideo) (http://www.youtube.com/watch?v=Giws7czlNHI)
  2,708,703 Bytes [100.00%] received. Rate: [6968 KB/s].  ETA: [0 secs]
INFO: Converting Azet - Pam Pam.m4a to mp3
INFO: Applying metadata

INFO: 19. Juju feat. Henning May - Vermissen Lyrics (http://www.youtube.com/watch?v=UEQc5JIX4mA)
  2,575,577 Bytes [100.00%] received. Rate: [8133 KB/s].  ETA: [0 secs]
INFO: Converting Juju - Vermissen.m4a to mp3
INFO: Applying metadata

INFO: 20. 5 Songs in einer Nacht (Instrumental) (http://www.youtube.com/watch?v=YeXpky2rgVw)
  2,343,198 Bytes [100.00%] received. Rate: [8780 KB/s].  ETA: [0 secs]
INFO: Converting Capital Bra - 5 Songs in einer Nacht.m4a to mp3
INFO: Applying metadata

INFO: 21. FARD ft. PA SPORTS & MOE PHOENIX - "SUPERHELDEN" (REMIX - AUDIO) (http://www.youtube.com/watch?v=5yGWyrgGT6g)
  2,654,092 Bytes [100.00%] received. Rate: [3545 KB/s].  ETA: [0 secs]
INFO: Converting Fard - Superhelden (feat PA Sports  Moe Phoenix) - Remix.m4a to mp3
INFO: Applying metadata

INFO: 22. Theme (from "Spider Man") (Original Television Series) (http://www.youtube.com/watch?v=X1a5d_tQL9c)
  636,899 Bytes [100.00%] received. Rate: [5806 KB/s].  ETA: [0 secs]
INFO: Converting J Robert Harris - Theme (from Spider Man) [Original Television Series].m4a to mp3
INFO: Applying metadata

INFO: 23. Ich find dich scheisse (http://www.youtube.com/watch?v=EXXBOXUC_B4)
  3,443,303 Bytes [100.00%] received. Rate: [10990 KB/s].  ETA: [0 secs]
INFO: Converting Tic Tac Toe - Ich find dich scheisse.m4a to mp3
INFO: Applying metadata

INFO: 24. Tic Tac Toe - Leck mich am A B Zeh Lyrics (http://www.youtube.com/watch?v=L1qVVw3bkWc)
  3,391,711 Bytes [100.00%] received. Rate: [7039 KB/s].  ETA: [0 secs]
INFO: Converting Tic Tac Toe - Leck mich am A B Zeh.m4a to mp3
INFO: Applying metadata

INFO: 25. Capital Bra - One Night Stand (HQ LYRICS/LYRIC VIDEO) (http://www.youtube.com/watch?v=Ezt85_mHDjs)
  2,574,492 Bytes [100.00%] received. Rate: [7734 KB/s].  ETA: [0 secs]
INFO: Converting Capital Bra - One Night Stand.m4a to mp3
INFO: Applying metadata

INFO: 26. Olexesh ft. Edin - MAGISCH (lyrics) (http://www.youtube.com/watch?v=bi_RZhcYMwA)
  3,893,198 Bytes [100.00%] received. Rate: [6842 KB/s].  ETA: [0 secs]
INFO: Converting Olexesh - Magisch.m4a to mp3
INFO: Applying metadata

INFO: 27. Die Firma - Die Eine 2005  (Official Video) (http://www.youtube.com/watch?v=HR00F3VnlcE)
  3,338,461 Bytes [100.00%] received. Rate: [6773 KB/s].  ETA: [0 secs]
INFO: Converting Tune Robbers - Die Eine 2005.m4a to mp3
INFO: Applying metadata

INFO: 28. EO - German (Lyrics) (http://www.youtube.com/watch?v=J0SbGzYujrY)
  2,732,702 Bytes [100.00%] received. Rate: [8248 KB/s].  ETA: [0 secs]
INFO: Converting EO - German - Remix.m4a to mp3
INFO: Applying metadata

INFO: 29. * Eule * Mittelfingermodus * (http://www.youtube.com/watch?v=uRfsU0jy2mI)
  3,105,923 Bytes [100.00%] received. Rate: [8721 KB/s].  ETA: [0 secs]
INFO: Converting EULE - Mittelfingermodus.m4a to mp3
INFO: Applying metadata

INFO: 30. Stars singen MÄDCHEN GEGEN JUNGS aus Bibi & Tina (http://www.youtube.com/watch?v=2Gpt_hvaiSg)
  2,853,342 Bytes [100.00%] received. Rate: [6163 KB/s].  ETA: [0 secs]
INFO: Converting Sido - Mädchen gegen Jungs - All-Star-Version.m4a to mp3
INFO: Applying metadata

INFO: 31. Eule - Deja Vu 🎶 (http://www.youtube.com/watch?v=2XEmTHKzgeg)
  3,095,919 Bytes [100.00%] received. Rate: [7621 KB/s].  ETA: [0 secs]
INFO: Converting EULE - Wenn der Beat dropped.m4a to mp3
INFO: Applying metadata

INFO: 32. Stern des Südens | FC Bayern (Original) (http://www.youtube.com/watch?v=o5XqRGQ8vng)
  2,715,859 Bytes [100.00%] received. Rate: [6618 KB/s].  ETA: [0 secs]
INFO: Converting FC Bayern München Stimmen des Südens - Stern des Südens.m4a to mp3
INFO: Applying metadata

INFO: 33. MERO - HOBBY HOBBY LYRICS (mit Video) (http://www.youtube.com/watch?v=_Z2CcUh6awU)
  2,366,321 Bytes [100.00%] received. Rate: [7624 KB/s].  ETA: [0 secs]
INFO: Converting MERO - Hobby Hobby.m4a to mp3
INFO: Applying metadata

INFO: 34. * Eule * Lauter * (http://www.youtube.com/watch?v=cEzd9ofmTKw)
  3,492,940 Bytes [100.00%] received. Rate: [7869 KB/s].  ETA: [0 secs]
INFO: Converting EULE - Lauter.m4a to mp3
INFO: Applying metadata

INFO: 35. EULE   Musik an Welt aus Official Video (http://www.youtube.com/watch?v=qQ-q-kKDCI0)
  2,851,979 Bytes [100.00%] received. Rate: [10204 KB/s].  ETA: [0 secs]
INFO: Converting EULE - Musik an Welt aus.m4a to mp3
INFO: Applying metadata

ERROR: No videos found on YouTube for a given search

INFO: 38. Nummer unterdrückt (http://www.youtube.com/watch?v=2WGDZT4x5mA)
  3,382,046 Bytes [100.00%] received. Rate: [10451 KB/s].  ETA: [0 secs]
INFO: Converting Bonez MC - Nummer unterdrückt.m4a to mp3
INFO: Applying metadata

As you can see, two songs can't be downloaded - I'm in the UK and they might not be available on YouTube here.
Here's the output with -ll DEBUG for said songs:
DEBUG: Input song is a Spotify URL
DEBUG: Fetching metadata for given track URL
DEBUG: Fetching lyrics
DEBUG: {'album': {'album_type': 'album',
               'artists': [{'external_urls': {'spotify': 'https://open.spotify.com/artist/6ZnVK66TWa0x1BvSqM6ZUi'},
                            'href': 'https://api.spotify.com/v1/artists/6ZnVK66TWa0x1BvSqM6ZUi',
                            'id': '6ZnVK66TWa0x1BvSqM6ZUi',
                            'name': 'EULE',
                            'type': 'artist',
                            'uri': 'spotify:artist:6ZnVK66TWa0x1BvSqM6ZUi'}],
               'external_urls': {'spotify': 'https://open.spotify.com/album/6iAW6ukurKSIwYcJPoiFF4'},
               'href': 'https://api.spotify.com/v1/albums/6iAW6ukurKSIwYcJPoiFF4',
               'id': '6iAW6ukurKSIwYcJPoiFF4',
               'images': [{'height': 640,
                           'url': 'https://i.scdn.co/image/80d00a367c8efcd46fd39b42ac1cb1e29cbad966',
                           'width': 640},
                          {'height': 300,
                           'url': 'https://i.scdn.co/image/729051ab3b17dfb3a2239c96a64336b704c772d9',
                           'width': 300},
                          {'height': 64,
                           'url': 'https://i.scdn.co/image/953e0e31072cfd5cd9fd2e7a4826f3a35cd63085',
                           'width': 64}],
               'name': 'Musik an, Welt aus',
               'release_date': '2018-04-13',
               'release_date_precision': 'day',
               'total_tracks': 19,
               'type': 'album',
               'uri': 'spotify:album:6iAW6ukurKSIwYcJPoiFF4'},
     'artists': [{'external_urls': {'spotify': 'https://open.spotify.com/artist/6ZnVK66TWa0x1BvSqM6ZUi'},
                  'href': 'https://api.spotify.com/v1/artists/6ZnVK66TWa0x1BvSqM6ZUi',
                  'id': '6ZnVK66TWa0x1BvSqM6ZUi',
                  'name': 'EULE',
                  'type': 'artist',
                  'uri': 'spotify:artist:6ZnVK66TWa0x1BvSqM6ZUi'}],
     'copyright': '© 2018 RTL2 Fernsehen GmbH & Co. KG',
     'disc_number': 1,
     'duration': 175.813,
     'explicit': False,
     'external_ids': {'isrc': 'DEWS51800012'},
     'external_urls': {'spotify': 'https://open.spotify.com/track/1xVXa0HKrAxmy3twLIC9LX'},
     'genre': 'German Pop',
     'href': 'https://api.spotify.com/v1/tracks/1xVXa0HKrAxmy3twLIC9LX',
     'id': '1xVXa0HKrAxmy3twLIC9LX',
     'is_local': False,
     'lyrics': None,
     'name': 'Social Game',
     'popularity': 23,
     'preview_url': None,
     'publisher': 'Polydor/Island',
     'release_date': '2018-04-13',
     'spotify_metadata': True,
     'total_tracks': 19,
     'track_number': 11,
     'type': 'track',
     'uri': 'spotify:track:1xVXa0HKrAxmy3twLIC9LX',
     'year': '2018'}
DEBUG: Opening URL: https://www.youtube.com/results?sp=EgIQAQ%253D%253D&q=EULE%20-%20Social%20Game%20lyrics
DEBUG: Could not find video duration on YouTube, retrying..
DEBUG: Opening URL: https://www.youtube.com/results?sp=EgIQAQ%253D%253D&q=EULE%20-%20Social%20Game%20lyrics
DEBUG: Could not find video duration on YouTube, retrying..
DEBUG: Opening URL: https://www.youtube.com/results?sp=EgIQAQ%253D%253D&q=EULE%20-%20Social%20Game%20lyrics
DEBUG: Could not find video duration on YouTube, retrying..
DEBUG: Opening URL: https://www.youtube.com/results?sp=EgIQAQ%253D%253D&q=EULE%20-%20Social%20Game%20lyrics
DEBUG: Could not find video duration on YouTube, retrying..
DEBUG: Opening URL: https://www.youtube.com/results?sp=EgIQAQ%253D%253D&q=EULE%20-%20Social%20Game%20lyrics
DEBUG: Could not find video duration on YouTube, retrying..
DEBUG: No tries left. I quit.
DEBUG: Found no matching video
DEBUG: Removing downloaded song from tracks file

DEBUG: Input song is a Spotify URL
DEBUG: Fetching metadata for given track URL
DEBUG: Fetching lyrics
DEBUG: {'album': {'album_type': 'album',
               'artists': [{'external_urls': {'spotify': 'https://open.spotify.com/artist/0rpos3tdyyc5uoxMM8Ptg9'},
                            'href': 'https://api.spotify.com/v1/artists/0rpos3tdyyc5uoxMM8Ptg9',
                            'id': '0rpos3tdyyc5uoxMM8Ptg9',
                            'name': 'Tune Robbers',
                            'type': 'artist',
                            'uri': 'spotify:artist:0rpos3tdyyc5uoxMM8Ptg9'}],
               'external_urls': {'spotify': 'https://open.spotify.com/album/6dnHvlOumZpDNScubm5VhB'},
               'href': 'https://api.spotify.com/v1/albums/6dnHvlOumZpDNScubm5VhB',
               'id': '6dnHvlOumZpDNScubm5VhB',
               'images': [{'height': 600,
                           'url': 'https://i.scdn.co/image/db61037151a97e227c09710061e579af8bbcd753',
                           'width': 600},
                          {'height': 300,
                           'url': 'https://i.scdn.co/image/02b2325104edf492465da49d1cb11afebacab684',
                           'width': 300},
                          {'height': 64,
                           'url': 'https://i.scdn.co/image/2c96ad0918a1aba7c8a74467e530957fdf6c1d28',
                           'width': 64}],
               'name': "The Tune Robbers' German Hit Mix",
               'release_date': '2010-05-01',
               'release_date_precision': 'day',
               'total_tracks': 15,
               'type': 'album',
               'uri': 'spotify:album:6dnHvlOumZpDNScubm5VhB'},
     'artists': [{'external_urls': {'spotify': 'https://open.spotify.com/artist/0rpos3tdyyc5uoxMM8Ptg9'},
                  'href': 'https://api.spotify.com/v1/artists/0rpos3tdyyc5uoxMM8Ptg9',
                  'id': '0rpos3tdyyc5uoxMM8Ptg9',
                  'name': 'Tune Robbers',
                  'type': 'artist',
                  'uri': 'spotify:artist:0rpos3tdyyc5uoxMM8Ptg9'}],
     'copyright': '2010 Rosenklang',
     'disc_number': 1,
     'duration': 230.87,
     'explicit': False,
     'external_ids': {'isrc': 'CAM461051805'},
     'external_urls': {'spotify': 'https://open.spotify.com/track/4w25g0KUEebHF3JFRb9PWJ'},
     'genre': None,
     'href': 'https://api.spotify.com/v1/tracks/4w25g0KUEebHF3JFRb9PWJ',
     'id': '4w25g0KUEebHF3JFRb9PWJ',
     'is_local': False,
     'lyrics': None,
     'name': 'Oh Shit - Frau Schmidt',
     'popularity': 11,
     'preview_url': 'https://p.scdn.co/mp3-preview/37a41f3d8d6b041965bf1bab6e2bd019cb19cad6?cid=4fe3fecfe5334023a1472516cc99d805',
     'publisher': 'Rosenklang',
     'release_date': '2010-05-01',
     'spotify_metadata': True,
     'total_tracks': 15,
     'track_number': 11,
     'type': 'track',
     'uri': 'spotify:track:4w25g0KUEebHF3JFRb9PWJ',
     'year': '2010'}
DEBUG: Opening URL: https://www.youtube.com/results?sp=EgIQAQ%253D%253D&q=Tune%20Robbers%20-%20Oh%20Shit%20-%20Frau%20Schmidt%20lyrics
ERROR: No videos found on YouTube for a given search
DEBUG: Found no matching video
DEBUG: Removing downloaded song from tracks file

It is a bit of a pain to rerun the download of a big playlist with DEBUG LOG

BTW this shouldn't be a problem assuming spotify-downloader will not remove the track URL from your text file when above error occurs - just use --write-successful in combination with --skip - see https://github.com/ritiek/spotify-downloader/wiki/Available-options
Installed package versions:
➜  ~ pip freeze | grep spotdl
spotdl==1.2.2
➜  ~ pip freeze | grep youtube-dl
youtube-dl==2019.7.16
➜  ~ pip freeze | grep spotipy
spotipy==2.4.4
➜  ~


Tooltip go off screen

showTooltip(target, parent, text) {
    RNTooltips.Show(
	target,
	parent,
	{
		text: text,
		tintColor: '#ffffff',
		textColor: '#4a4a4a',
		textSize: 16,
		duration: 1000,
		corner: 8,
		clickToHide: true,
		autoHide: true,
		duration: 3
	}
    )
}

<View ref={ref => this.parent = ref}>
    <View>
        <ScrollView>
            <View>
                <TouchableOpacity ref={ref => this.target = ref} onPress={() => this.showTooltip(this.target, this.parent, 'hello')}>
                </TouchableOpacity>
            </View>
        </ScrollView>
    <View>
</View>

I'm testing with iOS 14.1, I noticed that with some dimensions there are no problems, for example setting width: 200 on the parent, but on the same component putting width: 300 or width: '100%' the tooltip goes off screen

I have same problem on android, my screen is on landscape mode and the tooltip at the corner overlaps the OS soft keys.
It also has a small offset on LANDSCAPE_RIGHT but its ok on the LANDSCAPE_LEFT

I have same problem on ios if element close to screen edge


Update the UWP page to 2.x

Fixes #446
Fixes #467

@AndriySvyryd,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot

There are too many things in this tutorial that won’t work until we release EF Core 2.0.1 patch. Not planning to merge until then.

@anpete while doing the UWP verification for 2.0.1 found that VS fails to add a project reference to a class library that has both targets: <TargetFrameworks>netcoreapp2.0;netstandard2.0</TargetFrameworks>. If you add the reference first and then add the netcoreapp2.0 target, it will kind of work but complain with a yellow bang on the reference. We don't know what else could be broken. Given that, I believe we should just recommend customers create a separate netcoreapp2.0 console app that targets the same netstandard2.0 library.

I think @ryanbrandenburg ran into the same issue

@AndriySvyryd Now that the patch is out, customers should be able to follow the updated walkthrough, right? Is there anything else that needs to be updated?

@divega It's up-to-date AFAIK


SDL Create Windows is not working (in plush)

I was trying to use run the draw_font.pls in the benchmarks folder, but it doesn't seem to work.
EDIT:
It seems like the create_window function in cpp get passed the wrong type of values.
I'm not sure what's going on.

So I'm trying to dig deeper and I created a dull function in the window package that just returns the sum of 2 ints. I was checking their types with assert in cpp and apparently the first argument has the correct type, but the second one doesn't. This is similar to what happens with create_window, where the first argument is fine but the second and the third are not.
Maybe this could be the cause?

I solved this.
I will make a Pull Request when the one that is still open will be closed.


codemining.java.codeutils.MethodExtractor NOT FOUND in codemining-core

Hi Miltos,
I want to use this project to mine code idioms, but I encounter a problem:
SampleBlockedTSG uses class java.codeutils.MethodExtractor,
but I cannot find MethodExtractor in codemining-core.
Is there something wrong happened?
I guess maybe it is a version conflict between codemining-core and codemining-treelm?
I'll appreciate it if you can give me some help. Now I'm writting my own MethodExtractor in order to run SampleBlockedTSG...
Best regards,
Zeqi

Hi Zeqi,
This seems to be missing from codemining-core. Find the missing file attached.
MethodExtractor.java.zip
If you find the time, can you submit a PR in codemining-core merging this (unzipped) file? Thanks!


CVE-2023-36884 coverage

CVE-2023-36884
New Analytic Story

CVE-2023-36884 - Office and Windows HTML RCE Vulnerability

Appended Analytics

modified:   detections/endpoint/mshtml_module_load_in_office_product.yml
modified:   detections/endpoint/office_product_spawn_cmd_process.yml
modified:   detections/endpoint/office_product_spawning_bitsadmin.yml
modified:   detections/endpoint/office_product_spawning_certutil.yml
modified:   detections/endpoint/office_product_spawning_mshta.yml
modified:   detections/endpoint/office_product_spawning_rundll32_with_no_dll.yml
modified:   detections/endpoint/office_product_spawning_windows_script_host.yml
modified:   detections/endpoint/office_product_spawning_wmic.yml
Office Document Spawned Child Process To Download

Thorough updates! LGTM


Env does not override nested value when other sources are used

In this example, If I use YAML source, I cannot override sub_value field with an environment variable.
In main.py:
from pydantic import Field
from pydantic_settings import (
    BaseSettings,
    PydanticBaseSettingsSource,
    SettingsConfigDict,
    YamlConfigSettingsSource,
)

class PydanticBaseSettings(BaseSettings):

    @classmethod
    def settings_customise_sources(
        cls,
        settings_cls: type[BaseSettings],
        init_settings: PydanticBaseSettingsSource,
        env_settings: PydanticBaseSettingsSource,
        dotenv_settings: PydanticBaseSettingsSource,
        file_secret_settings: PydanticBaseSettingsSource,
    ) -> tuple[PydanticBaseSettingsSource, ...]:
        return (init_settings, env_settings, dotenv_settings,
                YamlConfigSettingsSource(settings_cls), file_secret_settings)

class SubSettings(BaseSettings):
    model_config = SettingsConfigDict(env_prefix="sub_")
    value: str

class Settings(PydanticBaseSettings):
    model_config = SettingsConfigDict(yaml_file="config.yaml")

    value: str
    sub: SubSettings = Field(default_factory=SubSettings)

print(Settings())

In config.yaml:
value: a

sub:
  value: a

In terminal: value=b sub_value=b python -m main
Gives:
value='b' sub=SubSettings(value='a')
The first value is overridden, but the second is not. If I do not use YAML source everything works as expected. I tried using PydanticBaseSettings for SubSettings, but it doesn't help.

Thanks @rusmux for reporting this.
Your example code has some problems:

You have to use BaseModel instead of BaseSettings in sub-models https://docs.pydantic.dev/latest/concepts/pydantic_settings/#parsing-environment-variable-values
The env_prefix in sub-model does not have any effect, because pydantic-settings only considers the config of root model
Better to use env_nested_delimiter config for sub models

So, at the end you can collect values like you want by changing your code to:
from pydantic import Field, BaseModel
from pydantic_settings import (
    BaseSettings,
    PydanticBaseSettingsSource,
    SettingsConfigDict,
    YamlConfigSettingsSource,
)

class PydanticBaseSettings(BaseSettings):

    @classmethod
    def settings_customise_sources(
        cls,
        settings_cls: type[BaseSettings],
        init_settings: PydanticBaseSettingsSource,
        env_settings: PydanticBaseSettingsSource,
        dotenv_settings: PydanticBaseSettingsSource,
        file_secret_settings: PydanticBaseSettingsSource,
    ) -> tuple[PydanticBaseSettingsSource, ...]:
        return (init_settings, env_settings, dotenv_settings,
                YamlConfigSettingsSource(settings_cls), file_secret_settings)

class SubSettings(BaseModel):
    value: str

class Settings(PydanticBaseSettings):
    model_config = SettingsConfigDict(yaml_file="config.yaml", env_nested_delimiter="__")

    value: str
    sub: SubSettings

print(Settings())

You need to call your script by value=b sub__value=c python ...

I see, thank you!


DRILL-4819 - update MapR version to 5.2.0

https://issues.apache.org/jira/browse/DRILL-4819

LGTM.
+1


Is it possible to set mail header Content-Transfer-Encoding

Is it possbile to set the mail header "Content-Transfer-Encoding" ?
Or any workaround I can try to set this. My help desk said the mail cannot be parsed due to missing this header information.

It looks like most servers/clients assume "default" values for Content-Transfer-Encoding (and several other email header components).  I added Mime-Type, Content-Type, & Content-Transfer-Encoding explicitly which you can see on Line 221 of ipwatch.py here.
Reclone the project and let me know if it works.

The latest version works as expected. Thanks a lot.
Also if I want to send mail to multi receivers, I should list all of their email addresses in the receiver_email and delimited by ";" ?
Is it possible to add an example in readme or wiki.

I think I should create a separate issue for multi receivers.
The content transfer encoding issue can be closed.