externalReferences type for "source" packages

Sorry if I overlooked something obvious, but I miss a way to specify a source archive url for a component, as logical counterpart to the distribution type.
Many ecosystems have the concept of a source and a somehow derived package. In Python's PyPI you have a "wheel" and a "source" package (check https://pypi.org/project/chardet/#files), for Linux packages there are binary and corresponding source packages (check https://packages.debian.org/buster/libgcc1) etc.
Deriving the correct "source" package for a component isn't always straight-forward, but important for many use-cases (for example for license clearing, for mapping source-level sec advisories to binary components etc.). So it would be very helpful to store them in a CycloneDX BOM in a canonical way. Therefore I suggest to add a source type for externalReferences.
Note that this is in most cases not equal to the "vcs" type (which is often some kind of upstream project) because many repositories provide an own source archive exactly reflecting what was used when building their "binary" packages.
Example:
      "name": "chardet",
      "version": "4.0.0",
      "externalReferences": [
        {
          "type": "distribution",
          "url": "https://files.pythonhosted.org/packages/19/c7/fa589626997dd07bd87d9269342ccb74b1720384a4d739a1872bd84fbe68/chardet-4.0.0-py2.py3-none-any.whl",
          "comment": "PyPI wheel file"
        },
        {
          "type": "source",
          "url": "https://files.pythonhosted.org/packages/ee/2d/9cdc2b527e127b4c9db64b86647d567985940ac3698eeabc7ffaccb4ea61/chardet-4.0.0.tar.gz",
          "comment": "PyPI source archive"
        },
        {
          "type": "vcs",
          "url": "https://github.com/chardet/chardet",
          "comment": "upstream repository"
        }
      ]

Distribution is intentionally not specific to binary, source, hybrid, or other. Multiple distributions can be specified for a component.
Take Maven for example. A single component may have multiple artifacts that are part of the distribution.
https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/3.3.1/
In this case, there's artifacts for the:

binary
javadoc
sources
tests
test sources
pom

It's not the intent to describe every possible artifact type for every ecosystem.  I think if we start separating out the types of distributions, we'll create confusion as not all ecosystems are black and white (source and binary).
For ecosystems where the component is the source (e.g. Perl), there would be confusion about which type to use as both distribution and source could be equally relevant.  Javascript (npm) could actually be a hybrid containing both source and binary depending on the package.
In the Python example provided, it's easy enough to identify which distribution is the wheel and which one is not. In the Maven example, Maven has naming conventions so simple pattern matching against the distributions will tell you what they are. Other ecosystems may not be as predictable.
@coderpatros, @DarthHater what are your thoughts?

Ah, I see, so for my example above I should just use this today:
      "name": "chardet",
      "version": "4.0.0",
      "externalReferences": [
        {
          "type": "distribution",
          "url": "https://files.pythonhosted.org/packages/19/c7/fa589626997dd07bd87d9269342ccb74b1720384a4d739a1872bd84fbe68/chardet-4.0.0-py2.py3-none-any.whl",
          "comment": "PyPI wheel file"
        },
        {
          "type": "distribution",
          "url": "https://files.pythonhosted.org/packages/ee/2d/9cdc2b527e127b4c9db64b86647d567985940ac3698eeabc7ffaccb4ea61/chardet-4.0.0.tar.gz",
          "comment": "PyPI source archive"
        },
        {
          "type": "vcs",
          "url": "https://github.com/chardet/chardet",
          "comment": "upstream repository"
        }
      ]

And it would be the task of the application to either do pattern matching in the URL to differentiate between package types or use other means like application specific comment conventions.

@gernot-h is this still an open issue?

@gernot-h is this still an open issue?

Yes, definitely. Within Siemens AG, we created a kind of downstream specification extending and narrowing down CycloneDX (parts of it are public in https://github.com/siemens/cyclonedx-property-taxonomy). As a workaround, we specify defined comment fields:

We would highly appreciate if there would be some interoperable upstream solution for it, so BOM scanners can be extended to provide this information over time.
We btw also had a discussion whether a 2nd purl entry for stating source references might be needed as source urls are never unambiguous, but for now, we don't think it's a good idea.

That VCS reference could point to the general VersionControlSystem of the project,
while source could point to the actual source used for generating the component, which is not necessarily hosted in a VCS and is not intended to be distributed.
But then there already is the idea of source distribution, which is a specific type of distribution, one that is intended to be used downstream.
Why would it be necessary to document the source of a component, if it was not distributed from source in the first place?
How I see this: If you had a SBOM for product A which has a component B, and B was built/assembled/compiled/generated/packed from some source, then this B should provide a BOM for itself, describing the build process. Providing these capabilities is the goal of #31
There is no need for readers of A's BOM to know how B was built. All that is needed to know is where B came from(distribution) and have some hashes for integrity-checks on B.

A VCS reference would not be sufficient even in cases where the source code is hosted in a public VCS, because we would want a reference to the sources for the particular version of the component, which is always a deep link. Example:

VCS: https://github.com/apache/commons-lang
Source reference: https://github.com/apache/commons-lang/archive/refs/tags/rel/commons-lang-3.12.0.zip

Determining this deep link to the correct sources can require specific knowledge of the source ecosystem. For example, it may be necessary to understand how Maven Central handles source archives, or what a Golang Proxy is.
Therefore, it would be great if the tool which has this knowledge (such as a CycloneDX scanner) could also record it in its output SBOM.
Currently, it can do so in an externalReferences section with type distribution:
"externalReferences": [
  {
    "type": "distribution",
    "url": "https://github.com/apache/commons-lang/archive/refs/tags/rel/commons-lang-3.12.0.zip",
    "comment": "source archive (download location)"
  }
]

While such an entry is correct, it is very difficult to consume. There can easily be multiple distribution entries - which one contains the source reference?
We currently work around this problem by using a defined comment string, but that is obviously a fragile construct which doesn't scale to partners and customers.
A type of source (or any other type which is clearly distinguished) would greatly improve our situation here.

Looks like this topic was already picked up as proposed enhancement, but let me still try to answer the question.

Why would it be necessary to document the source of a component, if it was not distributed from source in the first place? I still do not understand.
How I see this: If you had a SBOM for product A which has a component B, and B was built/assembled/compiled/generated/packed from some source, then this B should provide a BOM for itself, describing the build process. Providing these capabilities is the goal of #31.
There is no need for readers of A's BOM to know how(from which source) B was built or claimed to be built. All that is needed to know is where B came from(distribution) and have some hashes for integrity-checks on B.

For us, this is a compliance as well as maintenance topic. Think about providing a Linux firmware image with several hundred packages based on a certain Linux distribution. Or think about providing a vendored NPM/Ruby... bundle as part of an application download or product.
Now you need to not only provide a "binary" SBOM for your customer, but you also need to check the licenses of all the contained components. And you might want to also mirror a snapshot of the used source packages internally in case you need to patch your product/app in 5 years from now. For all these topics, we need a "source BOM" describing the sources which were used by a 3rd party to provide the binary packages we used. (For well-designed eco systems like Python or Debian, the 3rd party provides this information, but all in different ways you want to import in a common format to a central place.) And we don't want to generate several hundred derived BOMs to describe how each of the integrated components was built.
I'm no security guy, but according to https://github.com/anchore/syft/issues/1700#issuecomment-1491967306, having the source information for a given "binary image BOM" is also valuable in vulnerability matching.
We think this is a use case relevant for many distribution use cases.

Thought about the same topic a lot.
Distribution not only have a URL, but

also have a Kind: either source or binary, where binary could be anything that is not source.
also have target constraints, like

OperatingSystem (examples: RedHat, Debian-9, NixOS, OpenBSD, Windows-11, Windows-XP, macOS-13.4, iOS-11.2, Android-9, TempleOS, ...)

maye even version ranges for the operating system ...

ProcessorArchitecture(i86, amd64, arm, M1, M2, ...)
Format(tar.gz, exe, rpm, deb, jar, war, phar, dmg, apk, wheel, egg, ...).

marker whether they were used during build proces (or are they yet alternatives)

There might be a lot of attributes related to a distribution, that might come in handy being documented.
In case you are documenting distributions in a BOM, for me, it is most important to mark the one distribution that you actually used to build your product.
I might not case about all the possible dists, but I must know which one was actually used during build processes, so that I could reproduce and attest the build.
Therefore, I would need a marker. (Would like to see an XML-constraint that allows only one of the distributions having this marker.)

Don't overthink it though. I would only need one extra item in the list of possible types. That list was already extended from 16 values in 1.4 to 39 values in 1.5. Let's make it 40 values in 1.6 by adding:

source = The URL of a source archive from which the component can be built

I don't need to know any additional details. (Of course, then I won't be able to actually build the component given only the SBOM, but frankly, that will be a problem no matter how much metadata you encode into the SBOM.)

I'm with @tsjensen on this. The latest spec revision already gives people plenty of options to choose from for specialized types of references. But the one that we are still missing for our needs is the reference to source code.
For us it is critical to not only have the information which specific distribution of a component is in use in an application, but also to reference the source it was generated from. This provenance information allows us to conduct additional analysis. For the scope of this analysis we do not need to have all the information to reproducibly build an artifact from source, a reference to the source itself is sufficient.
To provide a simple example:
For a component describing a maven package I would expect a "distribution" reference describing the maven repository layout the artifact came from and a "source" link that points to the GitHub release, VCS commit snapshot or any other deep link to the code the artifact was built from. With the current options for the reference type we have no option to clearly express both without resorting to comments.

we discussed this topic in our last core working group meeting.
It is still considered for 1.6. We might use an alternative wording. Something along "source-distribution".
CC @stevespringett @coderpatros @DarthHater @CycloneDX/core-team
// https://github.com/CycloneDX/specification/pull/269#issuecomment-1845834248

fixed via #269


[Feature]: Troubleshooting Taqueria

Describe the feature you would like
This will be a page listing known problems and fixes that will grow over time as we learn from users what the bugs and pain points are
Is this feature solving a problem?
T
Please share any additional details you have?
Details about the problem your feature solves
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Closing: Duplicate


[FEATURE] Support for lambdas in folds or point to the known issues

The documentation on folds says that one is not allowed to use lambdas in folds.
--------------------------- MODULE FoldSetLambda ------------------------------
EXTENDS Integers, Apalache

VARIABLE
    \* @type: Int;
    sum

\* LAMBDAS in folds are not supported by Apalache
\* Define a LET-IN operator Plus(p,q) == p + q instead
X == FoldSet(LAMBDA p,q: p + q, 0, {1,2,3})

Init ==
    sum = X

Next ==
    sum' = sum
===============================================================================

The post-type checker reports a type error:
[FoldSetLambda.tla:10:14-10:30]: No annotation found for LAMBDA$1. Make sure that you've put one in front of LAMBDA$1.

However, the issue is not in the type checker. If we look at the output of the preprocessor, here is what we see:
In 04_OutUnroll.tla:
(*
  @type: (() => Int);
*)
X ==
  FoldSet(LET (*
    @type: ((Int, Int) => Int);
  *)
  LAMBDA_si_1(p_si_1, q_si_1) == p$1 + q$1
  IN
  LAMBDA$1, 0, { 1, 2, 3 })

(*
  @type: (() => Bool);
*)
Init == sum = X

The types are perfectly fine.
In 05_OutInline.tla:
(*
  @type: (() => Bool);
*)
Init == sum = FoldSet(LAMBDA$1, 0, { 1, 2, 3 })

So the issue is in the inlining, not the type checker. We should do one of the following:

Fix the inliner to work correctly with folds and lambdas (why not?)
If we do not want to fix the inliner, the tool should complain at the place where lambda is used and point to the known issues.

@Kukovec , what do you think?

@Kukovec this is probably fixed, right?

@Kukovec has this been fixed with the inliner work?

IIRC the issue is that, while LAMBDA ... gets translated to a LET ... IN ..., it doesn't always know what type annotation to attach, when the operator is polymorphic (unlike the + above). I'll see if I can get a nicer counterexample (or if the issue's gone away)

So, if I change X to
X == ApaFoldSet(LAMBDA p,q: q, 0, {1,2,3}),

where the lambda is equivalent to
\* @type: (P,Q) => Q
Op(p, q) == q

The checker throws in BMC:
PASS #13: BoundedChecker                                          I@16:45:31.275
<unknown>: unexpected expression: Expected a non-polymorphic type, found: ((g, h) => h)
You may need to annotate an empty collection. E@16:45:31.283
test.tla:12:29-12:29: unexpected expression: Expected a non-polymorphic type, found: h
You may need to annotate an empty collection. E@16:45:31.284

For non-polymorphic lambdas, there's no issue, since they just get translated to the commonly supported LET-IN.

Note that there's still no way to annotate a lambda, so the question is only whether we're happy with the error message here. The 2nd line test.tla:12:29-12:29 identifies the q term in the lambda body accurately (though it might be worth looking into why the first line is <unknown>:, source tracking is broken here)

Sounds fine, let's close this one


TrendMicro is reporting HKTL_RADMIN threat for MSI

I am unsure if this is real, but our company trendmicro will not allow this to install.
HKTL_RADMIN
October 11, 2015
  Analysis by: Jaime Benigno Reyes
ALIASES:
RemoteAdmin.Win32.RAdmin.tw (Kaspersky), RemAdm-RemoteAdmin. (McAfee)
  PLATFORM:
Windows 2000, Windows Server 2003, Windows XP (32-bit, 64-bit), Windows Vista (32-bit, 64-bit), Windows 7 (32-bit, 64-bit)
  OVERALL RISK RATING:Low
  DAMAGE POTENTIAL:Low
  DISTRIBUTION POTENTIAL:Low
  REPORTED INFECTION:Low
  INFORMATION EXPOSURE:Low
Threat Type: Hacking Tool
Destructiveness: No
Encrypted: No
In the wild: Yes
Minimum Scan Engine:  9.700
FIRST VSAPI PATTERN FILE:  1.291.00
FIRST VSAPI PATTERN DATE:  24 May 2012

There is a single thread related to all antivirus problems: #277


Add install and test action (Windows)

What type of PR is this?
/kind enhancement
What does this PR do / why do we need it:
The install and test github action has been enabled in this patch, the first version of the action test is only runs on windows-latest node, that means it is only tested in windows server 2019 env.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@Yikun Thanks a lot!

cc @leonwanghui
This patch only adds the windows test, as I mentioned before, the Travis CI changed the trial (free) plan with a 10K credit allotment.
So looks like the github action is the better choice, and I'd like to move our tinyms CI from travis CI to action completely in another PR.

cc @leonwanghui
This patch only adds the windows test, as I mentioned before, the Travis CI changed the trial (free) plan with a 10K credit allotment.
So looks like the github action is the better choice, and I'd like to move our tinyms CI from travis CI to action completely in another PR.

Sure, that would be great!


Auto import not working

VSCode Version:

Version: 1.38.1
Commit: b37e54c98e1a74ba89e03073e5a3761284e3ffb0
Date: 2019-09-11T13:30:08.229Z
Electron: 4.2.10
Chrome: 69.0.3497.128
Node.js: 10.11.0
V8: 6.9.427.31-electron.0
OS: Linux x64 5.0.0-29-generic snap

OS Version:

OS: Ubuntu 18.04.3 LTS x86_64
Host: HP Pavilion Laptop 15z-cw100
Kernel: 5.0.0-29-generic

settings.json

{
  "editor.fontSize": 18,
  "editor.wordWrap": "on",
  "editor.lineNumbers": "relative",
  "emmet.triggerExpansionOnTab": true,
  "liveServer.settings.donotShowInfoMsg": true,
  "workbench.startupEditor": "newUntitledFile",
  "window.menuBarVisibility": "toggle",
  "window.zoomLevel": 0,
  "emmet.includeLanguages": {
    "javascript": "javascriptreact"
  },
  "emmet.syntaxProfiles": {
    "javascript": "jsx"
  },
  "liveServer.settings.donotVerifyTags": true,
  "javascript.updateImportsOnFileMove.enabled": "always",
  "terminal.integrated.fontSize": 17,
  "workbench.sideBar.location": "left",
  "workbench.editor.enablePreviewFromQuickOpen": true,
  "editor.showUnused": true,
  "editor.tabSize": 2,
  "editor.formatOnSave": true,
  "prettier.singleQuote": true,
  "prettier.trailingComma": "es5",
  "workbench.colorCustomizations": {
    "[Dainty – Nord (chroma 2, lightness 3)]": {
      "list.activeSelectionBackground": "#4a5d7c"
    },
    "[Material Theme Palenight]": {
      "editorCursor.foreground": "#c7c7c7",
      "list.activeSelectionBackground": "#3b4a63"
    }
  },
  "html.autoClosingTags": false,
  "javascript.autoClosingTags": false,
  "vim.easymotion": true,
  "vim.enableNeovim": true,
  "vim.neovimPath": "nvim",
  "vim.incsearch": true,
  "vim.useSystemClipboard": true,
  "vim.useCtrlKeys": true,
  "vim.hlsearch": true,
  "vim.normalModeKeyBindingsNonRecursive": [
    {
      "before": [
        ""
      ],
      "commands": [
        ":nohl"
      ]
    },
    {
      "before": [
        "L"
      ],
      "after": [
        "$"
      ]
    },
    {
      "before": [
        "H"
      ],
      "after": [
        "^"
      ]
    },
    {
      "before": [
        "j"
      ],
      "after": [
        "g",
        "j"
      ]
    },
    {
      "before": [
        "Z",
        "Z"
      ],
      "commands": [
        ":wq"
      ]
    },
    {
      "before": [
        "y",
        "f"
      ],
      "after": [
        "v",
        "a",
        "{",
        "V"
      ]
    }
  ],
  "vim.visualModeKeyBindingsNonRecursive": [
    {
      "before": [
        "p"
      ],
      "after": [
        "p",
        "g",
        "v",
        "y"
      ]
    },
    {
      "before": [
        "y"
      ],
      "after": [
        "y",
        "g",
        "v",
        ""
      ]
    }
  ],
  "vim.leader": "",
  "vim.handleKeys": {
    "": true,
    "": false
  },
  "workbench.colorTheme": "Material Theme Palenight",
  "vim.easymotionMarkerHeight": 20,
  "vsicons.associations.folders": [
    {
      "icon": "container",
      "extensions": [
        "container",
        "containers"
      ],
      "format": "svg"
    }
  ],
  "vsicons.associations.folderDefault.folder": {
    "icon": "myFolder",
    "format": "svg"
  },
  "vsicons.associations.files": [
    {
      "icon": "myMarkdown",
      "extensions": [
        "md",
        "custom.md",
        "markdown",
        "mdown"
      ],
      "format": "svg",
      "overrides": "md"
    }
  ],
  "workbench.iconTheme": "vscode-icons",
  "breadcrumbs.filePath": "off",
  "debug.allowBreakpointsEverywhere": true,
  "terminal.integrated.fontFamily": "'PowerlineSymbols','Droid Sans Mono', 'monospace', monospace, 'Droid Sans Fallback'",
  "vim.easymotionMarkerFontWeight": "bold",
  "vim.easymotionMarkerFontSize": "15"
}

File structure

.
├── package.json
├── node_modules
├── public
├── src
│   ├── App.js
│   ├── App.scss
│   ├── App.test.js
│   ├── components
│   │   └── layout
│   │       ├── Landing.js
│   │       └── Navbar.js
│   ├── img
│   │   ├── icon.png
│   │   └── showcase.jpg
│   └── index.js
├── package.json
└── yarn.lock

Navbar.js
import React from 'react';

const Navbar = () => (
  <nav className="navbar bg-dark">
  </nav>
);

export default Navbar;

App.js
import React, { Fragment } from 'react';
import './App.scss';

const App = () => (
  <Fragment>
    Navbar
  </Fragment>
);

export default App;

Normally what should happen is place the cursor after "Navbar" then press Ctrl+Space then auto import suggestions should show. The result is 'No suggestions'. Made sure to restart TS server but that didn't help.

Have you tried creating a jsconfig.json?

So auto import does work if I am exporting it without using the default keyword export const Navbar. I think this is normal? Because it's been while since I worked on a react project and I just remembered that auto import works only when avoiding default.
In answer to your question. Yes I tried jsonfig.json and it didn't solve auto import with export default.

This same thing happens for me when using node.js/commonjs style default exports
For example:
foo.js
    const foo = "bar";
    module.exports = foo;

what I'll see in another file:

Adding to that, I've got a jsconfig.json that looks like the following:
{
	"compilerOptions": {
		"target": "es2015",
		"lib": ["es2015"],
		"module": "commonjs",
		"moduleResolution": "node",
		"checkJs": true
	},
	"include": ["./src/**/*", "./test/**/*"],
	"exclude": ["node_modules", "**/node_modules/*"]
}```

However I'm still getting `lib.dom.d.ts` suggestions. Maybe this is connected?

To add to my comment from before:
I've tried installing TS versions (all the way back to 3.5.3) globally (I made sure to change the tsdk setting) and locally (made sure to select the local version through > Select TypeScript version) and restart the TS server every time.
Still, I don't get any suggestions for imports at all when in a node.js project

Same, I don't understand how auto import is supposed to work, because it doesn't work at all in a JavaScript (not TypeScript) project. Can't get them to work in a node.js commonJS project and can't get them to work in a simple test project either.

@Gameghostify @fabis94 Open separate issues with example code. There are a lot of reasons why you may not see auto import working. Separate issues makes investigation easier


storcon: alert for long running reconciles

This is a follow-up from INC-291 where we had a live migration reconcile become stuck for multiple days.
We want an alert that for reconciliation that have been running for too long (defining "too long" is part of the issue).

Code merged in https://github.com/neondatabase/neon/pull/9207. Will add alert too.

Alerts created on storage_controller_reconcile_long_running_total > 0


SPFx solution as Teams Tab (in native client) with Graph : Cannot read property 'match' of undefined

[ ] Question
[ ] Typo
[X] Bug
[ ] Additional article idea

Expected or Desired Behavior
SPFx Solution with MS Graph works in MS Teams Native Clients.
Observed Behavior
Cannot read property 'match' of undefined
Steps to Reproduce
Create SPFx web part for Teams
add some MS Graph request
Try to run the web part as Teams tab
This Issue is related to issue: #4357
I tried the following instructions and they did not resolve the issue:
Manual Steps
Step 1. Go to -> https://aad.portal.azure.com/#blade/Microsoft_AAD_IAM/ActiveDirectoryMenuBlade/RegisteredAppsPreview
Step 2. Click on SharePoint Online Client Extensibility Web Application Principal
Step 3. Click Manifest on the left menu
Step 4. Remove all entries in the PasswordCredentials section (Should leave a empty array)
Step 5. Save the manifest
Step 6. Visit the new API Permission Management Page on the Tenant Admin Site. This creates a client secret behind the scenes.
Step 7. Wait 10 minutes

Facing the same issue with Microsoft Teams native client and Graph API Calls and it's not resolved by following the steps mentioned in the question too.

Any Update on this please?

@juanmlarios Finally found what the problem was. The fixes that are suggested will work for the webparts that are NOT configured to be hosted in Isolated domain. So according to my understanding 'SharePoint Online Client Extensibility Web Application Principal' serves here and permissions assigned to such webparts/apps are accessible to other (non-isolated) apps in the tenant as well. When webparts are configured to be hosted in an isolated domain, there is a dedicated application created in Azure AD for that webpart and granted permissions are limited to the corresponding webpart(s) only. But problems i.e. Teams Desktop client issue and Teams sdk issue, still persist with such webparts and Microsoft needs to provide solution for that.

And also there is a weird problem that appears when isolated webparts are installed as a tab in Microsoft Teams (at least this is the case with me). Every time the tab reloads, webpart is initialized/reset and property pane gets opened. while this is not the case with non-isolated webparts.

@wobba -  We're experiencing same issue. This issue is happening only in environment which has (Multi Factor Authentication) MFA enabled for user accounts and other environments are running when it is disabled.
Not sure whether MFA enabled accounts have an issue in accessing graph client via Teams Desktop.
This is my observation after spending 2 whole days. ;)

This issue still persists. We have followed the advice of @muradhaider5, i.e. configuring the web part to NOT be hosted in an isolated domain, but we are still receiving the same error.
Of note, we have created a demo O365 tenant to test further and found the following:

When logging into the Teams Desktop client with the demo's MOD Administrator, the teams tab loads without error
For other users, e.g. the demo's Megan Bowen, they do receive the error: Cannot ready property 'match' of undefined.

Any suggestions or updates on this issue?

Hi @VesaJuvonen  this is still an issue for my customer. Let me know if you need any other info to check into this further.

Update:
We found a blocking issue while rolling out the fix. We need to address this issue before moving forward with the rollout. I will return back with an update shortly.
Thank you for you patience.

Thanks for the update @lahuey , I can't believe it's been almost 5 months since the original issue. I am trying to understand how anyone is having success with the Graph API and Teams/SPFX solutions. Is this tenant-specific? is it only a few partners/customers experiencing this issue? would be nice to understand what the issue is exactly. I know my customer would appreciate an explanation. Any info you can share would be great. Thanks!

Is this issue already fixed or is there any update on it?
Currently showing a SharePoint page with an spfx webpart on it on a teams website tab.
The spfx webpart calls the Graph API to get the groups where the currently logged in user is a member of.
This works well for internal users, but not for external users. This is really a blocking issue as we are working with them on a day to day base in Teams.
External users have to use 2 factor authentication by company policy.
If I debug the page in Teams as an external user I also get this message "Cannot read property 'match' of undefined" when calling the Graph API.

@juanmlarios  - this should be absolutely addressed from the SPFx perspective, but it also depends on which API you call, as an example - in the case of @MistahG's question, issue is really on the Graph API side which apparently does not support this call for external users.
We cannot provide support for Graph APIs directly using this channel as their support model is through StackOverflow - and yes - we know that it's really hard for partners and customers to use multiple different location, but for Graph API questions - or issues in Graph API - correct location for questions is at https://stackoverflow.com/questions/tagged/microsoft-graph
If all Graph API calls are blocked in SharePoint Framework, then issue is absolutely on SharePoint Framework side and we'll need to have a look on this. @lahuey  can comment on the exact roll out situation on the issue he has found.

@VesaJuvonen than you for the work and update on this. I totally understand about the GraphAPI restrictions. I'll test and provide feedback but If there are issues with Graph I'll open up a ticket on the alternate thread. I am not calling Graph graph for external users so I suspect I should be just fine. Thanks again!

@VesaJuvonen Thanks for this quick follow up!
I forgot to mention that the page with the SPFx webpart on it that calls the Graph API is working fine if external users open it in SharePoint itself.
If the same page is displayed in Teams, external users get the error message that I mentioned earlier.
With this new information, should I still post this issue on StackOverflow?

@MistahG are you using cdn on the tenant, in case on/off has an impact here.

@MistahG - After struggling for couple of weeks, below steps worked for me.
Manual Steps
Step 1. Go to -> https://aad.portal.azure.com/#blade/Microsoft_AAD_IAM/ActiveDirectoryMenuBlade/RegisteredAppsPreview
Step 2. Click on SharePoint Online Client Extensibility Web Application Principal
Step 3. Click Manifest on the left menu
Step 4. Remove all entries in the PasswordCredentials section (Should leave a empty array)
Step 5. Save the manifest
Step 6. Visit the new API Permission Management Page on the Tenant Admin Site. This creates a client secret behind the scenes.
Step 7. Waited for 1 day.

Is there any update on when this issue will be fixed? I'm experiencing the issue specifically in the desktop app - my tab loads fine for all users on the teams web client, but in the desktop app it only works for the MOD administrator in our demo tenant.

The error is an artifact of an exception caused by parsing the error message. The fix has been submitted so it should roll out to customers within the next month.
@rapowell9 can you verify that the preauthorization section of the SPO Client Extensibility Application in the App Registrations (AAd Portal) page is not empty?

@lahuey
Yes, I populated that section as described in the previous thread, with the given app id and the permissionsId from the OAuth2Permissions array. Thanks for the update, and glad to hear the fix is nearly out

Was this issue resolved?

@maddya  - I followed below steps and issue was resolved.
Manual Steps
Step 1. Go to -> https://aad.portal.azure.com/#blade/Microsoft_AAD_IAM/ActiveDirectoryMenuBlade/RegisteredAppsPreview
Step 2. Click on SharePoint Online Client Extensibility Web Application Principal
Step 3. Click Manifest on the left menu
Step 4. Remove all entries in the PasswordCredentials section (Should leave a empty array)
Step 5. Save the manifest
Step 6. Visit the new API Permission Management Page on the Tenant Admin Site. This creates a client secret behind the scenes.
Step 7. Waited for 1 day.

Was this issue resolved?

@maddya  the above steps never worked for me, which is why I think this issue is still open. I gave up on this approach and totally dropped the SPFX model and went straight into Personal Teams APPs that hit the GraphAPI directly and I didn't have to go through SPFX. I assume this is a very complicated problem and a lot of moving pieces but it seems like there is no clear owner of this issue, as the SPFx team says it's fixed, and it's a graph issue, then the Graph team doesn't see an issue so it's tough to get to the bottom of it. I simply couldn't wait anymore as I had business-critical items I had to deliver.

We are having a very similar issue in a client.
We have two SPFx webparts as tabs in a Channel that make requests to Graph and Custom APIs that are not working in Teams Desktop app but they work perfectly in the web client. Any idea o workaround?

Hi @magarma - We had similar issue for our application last week. There is an update in manifest.json.
I shared mine here for your reference. Main change happened at static domain name are replaced with teamSiteDomain and worked like a charm.
Earlier : "contentUrl": "https://srinivasnarula.sharepoint.com/_layouts/15/teamslogon.aspx?SPFX=true&dest=/sites/Playground/Test.aspx"
Now :  "contentUrl": "https://{teamSiteDomain}/_layouts/15/teamslogon.aspx?SPFX=true&dest=/sites/Playground/Test.aspx"
here is the entire manifest.json file for your reference.
{
    "$schema": "https://developer.microsoft.com/en-us/json-schemas/teams/v1.10/MicrosoftTeams.schema.json",
    "manifestVersion": "1.11",
    "packageName": "GraphPersonaWebPart",
    "id": "3bbf7d18-69fa-4ecf-ad34-a0f15d5db19c",
    "version": "0.1",
    "developer": {
      "name": "Srinivas Narula",
      "websiteUrl": "https://products.office.com/en-us/sharepoint/collaboration",
      "privacyUrl": "https://privacy.microsoft.com/en-us/privacystatement",
      "termsOfUseUrl": "https://www.microsoft.com/en-us/servicesagreement"
    },
    "name": {
      "short": "GraphPersona"
    },
    "description": {
      "short": "GraphPersona Description",
      "full": "GraphPersona Description"
    },
    "icons": {
      "outline": "3bbf7d18-69fa-4ecf-ad34-a0f15d5db19c_outline.png",
      "color": "3bbf7d18-69fa-4ecf-ad34-a0f15d5db19c_color.png"
    },
    "accentColor": "#004578",
    "configurableTabs": [
      {
        "configurationUrl": "https://{teamSiteDomain}{teamSitePath}/_layouts/15/TeamsLogon.aspx?SPFX=true&dest={teamSitePath}/_layouts/15/teamshostedapp.aspx%3FopenPropertyPane=true%26teams%26componentId=3bbf7d18-69fa-4ecf-ad34-a0f15d5db19c%26forceLocale={locale}",
        "canUpdateConfiguration": true,
        "scopes": [
          "team"
        ]
      }
    ],
    "staticTabs": [
      {
          "entityId": "Test",
          "name": "Test Hub",
          "contentUrl": "https://{teamSiteDomain}/_layouts/15/teamslogon.aspx?SPFX=true&dest=/sites/Playground/Test.aspx",
          "websiteUrl": "https://{teamSiteDomain}/_layouts/15/teamslogon.aspx?SPFX=true&dest=/sites/Playground/Test.aspx",
          "scopes": [
              "personal"
          ]
      }
    ],
    "validDomains": [
      "*.login.microsoftonline.com",
      "*.sharepoint.com",
      "*.sharepoint-df.com",
      "spoppe-a.akamaihd.net",
      "spoprod-a.akamaihd.net",
      "resourceseng.blob.core.windows.net",
      "msft.spoppe.com"
    ],
    "webApplicationInfo": {
      "resource": "https://{teamSiteDomain}",
      "id": "00000003-0000-0ff1-ce00-000000000000"
    }
  }

Unfortunately, we already have the {teamSiteDomain} in the manifests. And it's working fine for others clients, so I think that there is something else.

Hi @magarma,
There are multiple things you can try here depending on what you are actually experiencing.
I will post some links and suggestions for you to check:

re-run Sync to Teams
https://github.com/SharePoint/sp-dev-docs/issues/7642#issuecomment-1011406368
https://github.com/SharePoint/sp-dev-docs/issues/7640#issuecomment-1021519426

Hey @magarma, one other thing to check: did you hit the API Access page as an user that has both SharePoint admin and Global admin roles? If there're some mismatches in the AAD application principal, by simply doing that action it should fix the majority of those.

Hi, thanks for the suggestion, we will ask the client to try that.
El mié., 9 feb. 2022 18:11, Luca Bandinelli @.***>
escribió:

Hey @magarma https://github.com/magarma, one other thing to check: did
you hit the API Access page as an user that has both SharePoint admin and
Global admin roles? If there're some mismatches in the AAD application
principal, by simply doing that action it should fix the majority of those.
—
Reply to this email directly, view it on GitHub
https://github.com/SharePoint/sp-dev-docs/issues/4915#issuecomment-1033995998,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACEDCF4FB44VCWOOCVZAKM3U2KN3LANCNFSM4JOURB5Q
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>


isSmartTV returns undefined for some useragents

I ran a few tests in Chrome dev tools overriding the the user agent to:
Mozilla/5.0 (SMART-TV; X11; Linux i686) AppleWebKit/535.20+ (KHTML, like Gecko) Version/5.0 Safari/535.20+
Mozilla/5.0 (SmartHub; SMART-TV; U; Linux/SmartTV) AppleWebKit/531.2+ (KHTML, like Gecko) WebBrowser/1.0 SmartTV Safari/531.2+
.. and the .isSmartTV value returns undefined instead of a Boolean.
Seems to correctly return false if it isn't a Smart TV though.

Should mention, these useragents were sourced form here:
https://developers.whatismybrowser.com/useragents/explore/operating_platform/smart-tv/


Named Transform Image Servlet producing blurry results

I have recently made use of the Named Transform Image Servlet.
When using crop the resulting image appears blurred as if scaled up form a lower resolution even starting with a high quality image and going down in size.
The scaling appears to work well, but the cropping produces a heavily blurred result.

@dterner can you provide the original image and the transform params you are using in this issue?

@dterner bump

@dterner double bump


Problem with docker installation

Hi,
I tried to install often using docker as mentioned in the doc but I'm facing the following error:
 > [vault 3/4] RUN wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add -     && sh -c 'echo "deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google.list'     && apt-get update && apt-get install -y     fonts-ipafont-gothic     fonts-kacst     fonts-thai-tlwg     fonts-wqy-zenhei     fonts-freefont-ttf     google-chrome-unstable     --no-install-recommends     && rm -rf /var/lib/apt/lists/*:
0.147 Warning: apt-key output should not be parsed (stdout is not a terminal)
0.900 OK
0.969 Get:1 http://deb.debian.org/debian buster InRelease [122 kB]
1.000 Get:2 http://deb.debian.org/debian-security buster/updates InRelease [34.8 kB]
1.014 Get:3 http://deb.debian.org/debian buster-updates InRelease [56.6 kB]
1.034 Get:4 http://dl.google.com/linux/chrome/deb stable InRelease [1825 B]
1.090 Get:5 http://deb.debian.org/debian buster/main arm64 Packages [7737 kB]
1.317 Get:6 http://deb.debian.org/debian-security buster/updates/main arm64 Packages [537 kB]
1.330 Get:7 http://deb.debian.org/debian buster-updates/main arm64 Packages [8780 B]
1.342 Get:8 http://dl.google.com/linux/chrome/deb stable/main amd64 Packages [1092 B]
1.981 Fetched 8499 kB in 1s (8061 kB/s)
1.981 Reading package lists...
2.270 Reading package lists...
2.547 Building dependency tree...
2.603 Reading state information...
2.635 E: Unable to locate package google-chrome-unstable
------
failed to solve: process "/bin/sh -c wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add -     && sh -c 'echo \"deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main\" >> /etc/apt/sources.list.d/google.list'     && apt-get update && apt-get install -y     fonts-ipafont-gothic     fonts-kacst     fonts-thai-tlwg     fonts-wqy-zenhei     fonts-freefont-ttf     google-chrome-unstable     --no-install-recommends     && rm -rf /var/lib/apt/lists/*" did not complete successfully: exit code: 100
make: *** [dev-build] Error 17

Can you reproduce it ? any idea how to fix it ?

This looks as if you're trying to build Offen from source. Is this what you want? Which installation instructions are you following?

This looks as if you're trying to build Offen from source. Is this what you want? Which installation instructions are you following?

Yes, I was trying with the documentation on this repository on README.md

Just to be clear: what you are doing is setting up a development environment for working on Offen. If this is not what you want, and you want to use Offen instead, here are some guides: https://docs.offen.dev/running-offen/

Assuming you do want to set up a development environment, I cannot really reproduce the issue as the images build fine for me. You can try building the offending image manually to see if it yields any further errors:
docker build --file=Dockerfile.node .

Ideally, this should build and exit 0. If it doesn't do that for you, could paste the log output here again so we can debug?

Closing this as it seems to be stale. If you need further support, feel free to reopen though.

I ran into the same issue trying to build the development environment (following the README).
When I issue the suggested:
docker build --file=Dockerfile.node .
I receive this:
 > [3/4] RUN wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add -     && sh -c 'echo "deb [arch=amd64] http
://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google.list'     && apt-get update && apt-get install -y     f
onts-ipafont-gothic     fonts-kacst     fonts-thai-tlwg     fonts-wqy-zenhei     fonts-freefont-ttf     google-chrome-unstable     --no-i
nstall-recommends     && rm -rf /var/lib/apt/lists/*:
0.159 Warning: apt-key output should not be parsed (stdout is not a terminal)
1.284 OK
1.531 Get:1 http://deb.debian.org/debian buster InRelease [122 kB]
1.531 Get:2 http://dl.google.com/linux/chrome/deb stable InRelease [1825 B]
1.699 Get:3 http://dl.google.com/linux/chrome/deb stable/main amd64 Packages [1082 B]
1.707 Get:4 http://deb.debian.org/debian-security buster/updates InRelease [34.8 kB]
1.771 Get:5 http://deb.debian.org/debian buster-updates InRelease [56.6 kB]
1.891 Get:6 http://deb.debian.org/debian buster/main arm64 Packages [7737 kB]
8.496 Get:7 http://deb.debian.org/debian-security buster/updates/main arm64 Packages [569 kB]
8.972 Get:8 http://deb.debian.org/debian buster-updates/main arm64 Packages [8780 B]
9.308 Fetched 8531 kB in 8s (1065 kB/s)
9.308 Reading package lists...
9.691 Reading package lists...
10.05 Building dependency tree...
10.13 Reading state information...
10.17 E: Unable to locate package google-chrome-unstable
------
Dockerfile.node:53
--------------------
  52 |     # installs, work.
  53 | >>> RUN wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add - \
  54 | >>>     && sh -c 'echo "deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google.list' \
  55 | >>>     && apt-get update && apt-get install -y \
  56 | >>>     fonts-ipafont-gothic \
  57 | >>>     fonts-kacst \
  58 | >>>     fonts-thai-tlwg \
  59 | >>>     fonts-wqy-zenhei \
  60 | >>>     fonts-freefont-ttf \
  61 | >>>     google-chrome-unstable \
  62 | >>>     --no-install-recommends \
  63 | >>>     && rm -rf /var/lib/apt/lists/*
  64 |
--------------------
ERROR: failed to solve: process "/bin/sh -c wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add -     && sh -c 'echo \"deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main\" >> /etc/apt/sources.list.d/google.list'     && apt-get update && apt-get install -y     fonts-ipafont-gothic     fonts-kacst     fonts-thai-tlwg     fonts-wqy-zenhei     fonts-freefont-ttf     google-chrome-unstable     --no-install-recommends     && rm -rf /var/lib/apt/lists/*" did not complete successfully: exit code: 100

Are you on non-amd64 hardware by an my chance?

I am indeed. I'm currently on an M1 Mac, so arm64. I assume the Google Chrome DEV version is not available on this platform.

Yeah, looks like this is the case. Still builds fine for me on an Intel Linux system.
I am not sure what the best fix for this is though. The package is installed so that puppeteer/mochify.js do not have to install Chromium on npm i and it can be cached, but maybe they would even pick the proper arch. I cannot test this though as I don't have matching hardware around. Could you try removing the apt package and remove the PUPPETEER_SKIP_CHROMIUM_DOWNLOAD env var and see if it builds?

Good to know you're set for now.
It seems it's possible to install Chromium on ARM64 as a snap though https://askubuntu.com/questions/1383789/install-chrome-on-ubuntu-debian-with-arm64
Not sure what this entails, but I'll leave it here for the record in case someone urgently needs this to work on ARM hardware.


Introduce UTM Remote client for iOS/visionOS

[x] Add UTM Remote server functionality for macOS
[x] Add UTM Remote client functionality for iOS
[x] Implement UI for picking server and connecting
[x] Refactor UTMQemuVirtualMachine to UTMSpiceVirtualMachine and UTMRemoteSpiceVirtualMachine
[x] Re-introduce socket support for SPICE client
[x] Support QEMU monitor/guest agent through named pipes (because we cannot use remote SPICE pipe to control QEMU)
[x] UPnP/NAT-PMP for WAN connections
[x] Synchronize VM states across server and multiple clients
[x] Support re-connection of SPICE session and UTM Remote session
[x] Support multiple sessions on iOS and visionOS

@osy are there plans to allow the Mac OS app to function as a generic SPICE client? Would be neat to be able to use this to connect to SPICE-capable VMs hosted on Proxmox, for example.

I think it would never be on the roadmap because it would be too much work. But most of the SPICE functionality is self contained in https://github.com/utmapp/CocoaSpice and it wouldn't be too much work to make a minimal client using it.


toggle position issue RTL application

Hi, my project is  ًُRTL  and i use I18nManager.forceRTL(true) for it,.. when I press toggle, its location has a problem

Sorry my poor English..

@NavidHosseini Sorry about it. For now, I don't have free time to fix it. Feel free to contribute the code to improve that one. I will merge if it passes the test case.
Thanks


fix(host-metrics)!: fix process.cpu.* metrics

Which problem is this PR solving?
This PR is changing/fixing process.cpu.time and process.cpu.utilization metrics which were not complying with the semantic conventions.
Short description of the changes
Get a 1st data collect when the modules is loaded and for each collection returns

time in seconds for user and system states
% of time in each state

Closes: #1718

Note for reviewer: I'm leveraging this PR also to update the attribute names for network and host metrics so we conform with the current status of semantic conventions

Thanks @pichlermarc :)
unfortunately I'm not allowed to merge it myself. Could you merge it please? What would be the next steps to be able to?

@legendecas Did you care to review this PR before it gets merged?


fix(get_win): typing of the get_win() fn win param

Description
vim.api.nvim_get_current_win() and vim.api.nvim_list_wins() return integer and integer[], respectively. Integer seems to be the correct typing annotation here. Similarly, edgebar.wins.win is a window ID integer, so the final conditional of this function is comparing the win param to an integer.
Related Issue(s)
n/a
Screenshots

ty


Whole computer is lagging since I downloaded this exact thing

Hi, I'm not used to github markdown so I don't know if It's the right way to submit issues, but since I downloaded the software, it started when using it as it lagged down my VR a lot, then it started lagging out other things such as discord or even my web browser, and even after deleting it the lag still goes on.
I don't know if it's a know issue or just me ?

Thats weird... did it happen only once or every time? It is possible that there was a memory leak somewhere, but I havent heard of such an issue yet

Well I am terribly sorry, looked like a heat wave just passed over my country when I downloaded it, turns out it was a computer ventilation issue and my CPU was litterally melting, terribly sorry again


New line before quitting watch mode

This is a tiny feature request. I don't think a PR is necessary, but I'd submit one if you want. Currently, when quitting watch mode using Q, CTRL+C or CTRL+D, process is terminated without printing a new line. This cause the current shell prompt to start mid-line, which not only is "ugly", but also buggy in some cases.
Fixing it should be trivial, placing outputStream.write("\n") before process.exit(0) in lines 164 and 207 of packages/jest-cli/src/watch.js.

PR welcome! :)


Changing the sequence length for BERT & performance on data with multi-class labels.

I've been working on this and got results close to what was mentioned in the paper for the IMDB dataset.
However, i'm facing a couple of issues.

Changing the sequence length that BERT accepts hasn't been straightforward. I want it changed to 128. I couldn't see that in 'mixtext.py'. 'normal_bert.py' contains 'length=256' in the definition for 'forward' but I'm unsure if this the one to change as I don't see 'length' being used anywhere else.
Please let me know how to change the sequence length for both normal_bert and mix_text.

I tried to run this on the sklearn's NewsGroup dataset - which contains 20 labels. I've appropriately changed the 'read_data.py' to take in this data & also performed back-translations as mentioned. But I couldn't get good results with 'MixText'. Whatever the amount of labeled data that I use, I get almost similar, very low accuracies. Training time also remains the same irrespective of what the labeled data is.
I'm assuming there is no issue with my data reading & pre-processing because 'normal_bert' runs fine.
Please do let me know if there is any known issue with using MixText for a multi-class dataset.

Thanks!

The sequences length should be passed into data pre-processing (tokenization)
For 20 labels, you might also want to tune the hyper-parameters like the sharpening temperature.

Hi.
Thanks a lot for the reply!
Just to confirm, I see max_seq_len in read_data.py and I'll change that value. But I also see '256' to be hard-coded at some places in train.py.
For example, here:
                'if length1 + length2 > 256:
                    length2 = 256-length1 - 1'

https://github.com/GT-SALT/MixText/blob/f17198d98e1bbb012d8e33cd26e228dd43bb4673/code/train.py#L308-L309
Please do let me know if I have to make any such additional changes.
Thanks!

Yes, this part in the train.py is actually not used. But you could definitely make modifications to them.


Webapp:az zip deploy through pipelines succeeds, but reports failure after loop.

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
https://bitbucket.org/microsoft/azure-web-apps-deploy/src/master/pipe/pipe.sh
Inside the "run az webapp deployment" command, the zip is deployed and unpacked. Then that command seems to loop on a query to "GET /api/deployments/latest HTTP/1.1" It will loop while it gets a 202 response, until finally it gets a 503, at which time python just breaks trying to parse the response.
INFO: Running deployment command...
DEBUG: urllib3.connectionpool : Starting new HTTPS connection (1): XXXXX.scm.azurewebsites.net:443
DEBUG: urllib3.connectionpool : https://XXXXX.scm.azurewebsites.net:443 "GET /api/deployments/latest HTTP/1.1" 202 557
INFO: Running deployment command...
DEBUG: urllib3.connectionpool : Starting new HTTPS connection (1): XXXXX.scm.azurewebsites.net:443
DEBUG: urllib3.connectionpool : https://XXXXX.scm.azurewebsites.net:443 "GET /api/deployments/latest HTTP/1.1" 202 557
INFO: Running deployment command...
DEBUG: urllib3.connectionpool : Starting new HTTPS connection (1): XXXXX.scm.azurewebsites.net:443
DEBUG: urllib3.connectionpool : https://XXXXX.scm.azurewebsites.net:443 "GET /api/deployments/latest HTTP/1.1" 202 557
INFO: Running deployment command...
DEBUG: urllib3.connectionpool : Starting new HTTPS connection (1): XXXXX.scm.azurewebsites.net:443
DEBUG: urllib3.connectionpool : https://XXXXX.scm.azurewebsites.net:443 "GET /api/deployments/latest HTTP/1.1" 503 326
ERROR: Expecting value: line 1 column 1 (char 0)
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/knack/cli.py", line 206, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 328, in execute
    raise ex
  File "/usr/local/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 386, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/local/lib/python3.6/site-packages/azure/cli/core/commands/__init__.py", line 379, in _run_job

To Reproduce
deploy a zip to an app service using the same command as the bitbucket pipeline?
Expected behavior
after successful deployment, success is reported.
Environment summary
Bitbucket pipeline docker

webapp

bug

please run command with --timeout parameter to increase the time out so that we don't timeout & throw a warning message since we were not able to get the status of the long running operation.


glossary entry for PodPreset

we use or wanted this and it was partially created for https://github.com/kubernetes-incubator/service-catalog . I don't know if that's appropriate to mention in the glossary. It moved from the core apiserver to our service catalog apiserver.
I don't know what options are available for tags, so I just picked one.
@bradtopol WDYT?

This change is

/lgtm

/approve


bug(loss not ignoring padding token in sequence)

I think the loss on this (line)[https://github.com/IBM/Grapher/blob/main/misc/utils.py#L19] should be ignore the padding tokens in the sequence, because they are just there because of variable sequence length. Let me know what you think.

Hi, you are right. Ideally, there should be a mask that removes effect of padding tokens in the loss. However, we have experimented with both (masking and no masking), and found no significant difference in the performance. This version of the code uses no masking to make code less cluttered.

Thank you for the information, that is useful to know and an interesting result! I think I will continue to have questions about the code / work, do you think Github issues is the best place to post them?

Two other questions I have are:

in your models you do not expand the vocabulary size of the language model to incorporate prediction of the new tokens you add to the tokenizer. Is this intentional?
have you ever had to clip gradients in order to make model training stable?


Added event.stopPropagation to enable support for nested scrollbars

I found that ngTinyScrollbar didn't behave well when nested inside itself. I added event.stopPropagation() to fix the event from bubbling up.
It doesn't have any adverse effects with the window scrolling.
I found that someone has submitted a similar PR for tinyscrollbar: https://github.com/wieringen/tinyscrollbar/pull/58
Hope this make it in! Let me know if I need to update something.
Thanks!
Will

Thanks! I'll try to review tonight and get a release pushed out.

Released in 0.9.3


Carousel Content Extracted from HTML

This may be an in progress change but if not could we put the carousel text and images in the json file, that way the code can be shrunk to a loop and (more significantly) the carousel can be edited from the CMS

Yeah Ill do that. I wanted to do that but I just wanted to get things out first.


PARQUET-477: Add clang-format / clang-tidy checks to toolchain

I adapted @emkornfield's work from ARROW-71 (https://github.com/apache/arrow/commit/5d129991b3369b0e45cb79d1efe6ba2fd8dd21d0). It's a large diff due to the first reformatting of the codebase. Per https://github.com/travis-ci/apt-source-whitelist/issues/199 we can switch Travis back to Ubuntu 14.04 and maybe upgrade to LLVM 3.8 at some point in the future.

+1, lots of changes but no problems ;)

+1, thank you.


Bootstrap forms

What is the change?
added Bootstrap Forms brief readme documentaion.
Related issue?
closes: #58
Checklist:
Before you create this PR, confirm all the requirements listed below by checking the checkboxes [x]:

[x] I have followed the Code of Conduct.
[x] I have  checked there aren't other open Pull Requests for the same update/change.
[x] I have you tested the code before submission.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[X] I'm HSOC'22 contributor.

Screenshots (if any)

@girija0707

@vickyrules congratulations 🔥 PR approved and merged


Fixed mode tinting

Set shifting : false should make bottomNav as Fixed(?), by doing it, how to tint label and icon to desired color as shown in repo gifs?

If you want to change the label- and icon-color, check the Documentation sections #BottomNavigation and #Tab. The props you are searching for are called activeIcon and activeLabelColor. You can check the examples if you don't know how to set those props, or take a look at #Usage.
Styling works the same for shifting and non-shifting Tabs.


Added functionality for click, mouseEnter and mouseLeave on annotation labels

New Pull Request
I saw that the AnnotationLabel type includes click, mouseEnter, and mouseLeave events, which are also mentioned in the documentation. However, no corresponding functionality was found in the codebase.
I replicated the logic from PointAnnotations.addPointAnnotation to implement these events.
Type of change
Please delete options that are not relevant.

[x] New feature (non-breaking change which adds functionality)

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] My changes generate no new warnings
[x] New and existing unit tests pass locally with my changes
[x] My branch is up to date with any changes from the main branch

@clarko0 The existing click, mouseEnter and mouseLeave events on annotation labels already work.
Please check the code here. Can you try creating a codepen example if these events aren't working for you?

Cheers for pointing this out, we must've been running an old version, without these changes. I'll close the PR.


Add multimovie

Source name
Multimovie
Source link
https://multimovies.uno/
Source language
Hindi And English
Other details
It have good interface and almost all movie and series and famous anime and k drama
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a title with source name.
[X] I have checked that the extension does not already exist on the website extensions list or the app.
[X] I have checked that the extension does not already exist by searching the GitHub repository and verified it does not appear in the code base.
[X] I will fill out all of the requested information in this form.

How you close

we already have multimovies extension

Sorry i seen hindi and don't find. But multimovie doesn't working solve this

if it's broken then create an issue under relevant issue template


Incorrect computation of the tangent space

In pyriemann.utils.tangentspace it appears the tangent space mapping is incorrect -- it only computes log(Cm^-.5XCm^-.5), which is not the full tangent mapping for the AIRM and is only true for log-euclid when Cm=I

(for completeness sake I'll add it here)
I was mistaken, the tangent space mapping for AIRM is indeed correct, however I was confused by the fact that the tangent space mapping with metric='logeuclid' doesn't actually map to the log-Euclidean tangent space, but the AIRM tangent space with the log-Euclidean metric used to compute the point around which the mapping takes place. In order to properly compute the log-euclidean points the metric='identity' must be used


[Improvement] Make the entity and arguments case-insensitive

What would you like to be improved?
At present, the requirement for entities to be entered in lowercase is not user-friendly. For instance, when I input "Metalake," the system returns an "Unknown entity" error. The intended purpose of this error message appears to be informing the user that the input is not a valid entity, such as a partition. i think both entity names and command arguments should be case-insensitive.

How should we improve?
Modify the validation logic for the entity and command parameters to make them case-insensitive.

@justinmclean I would like to work on it.

In general CLI commands are all lower case see https://clig.dev/#naming see "Use only lowercase letters,..."

In general CLI commands are all lower case see https://clig.dev/#naming see "Use only lowercase letters,..."

@justinmclean Should we provide some assistance information when the user inputs a command that is not in lowercase?

I really don't think a user would use mixed case, or if they did, it would be very very rare. If you want, feel free to convert the command and entity passed in to lowercase.

II would like to work on it.


Upgrade to pest v2

Resolves #978

Thanks @faissaloux! I does seem the test suite is failing here now for some reason... could you fix that?

Yeah, I don't know why that test failed! I'll check it whenever I can!

@driesvints The failed test was because of Notifications not being counted as before because of this PR https://github.com/laravel/framework/pull/49030 merged in v10.33  . I think it needs Telegram env variables TELEGRAM_BOT_TOKEN TELEGRAM_CHANNEL  to be passed to success, for now I have fixed the laravel/framework max version into v10.32.

Thanks @faissaloux!


Add Linter

:white_check_mark: Build GuiStracini.SDKBuilder 3.0.286 completed (commit https://github.com/guibranco/GuiStracini.SDKBuilder/commit/1f439574b9 by @guibranco)

:white_check_mark: Build GuiStracini.SDKBuilder 3.0.289 completed (commit https://github.com/guibranco/GuiStracini.SDKBuilder/commit/5a26ea4671 by @guibranco)


Fix yaml-cpp build issues

Attempts to fix a couple of issues since the yaml-cpp compatibility fixes for version 0.8.0.

Hi, can I ask somebody to please review and merge this? It's breaking CI for OSL and OIIO. Thanks.

@michdolan , @Shootfast , @KevinJW could one of you be Remi's second reviewer on this PR please?


Possibility to disabled the button

In SignInButton it's impossible to put null on onPressed because it's a required parameter.
Can you make it nullable?

Hi,
The login buttons are derived from the Material Button. Onpress is a required field.
Why do you want to leave this field null?

I found this in MaterialButton code :
  /// The callback that is called when the button is tapped or otherwise activated.
  ///
  /// If this callback and [onLongPress] are null, then the button will be disabled.
  ///
  /// See also:
  ///
  ///  * [enabled], which is true if the button is enabled.
  final VoidCallback? onPressed;

  /// The callback that is called when the button is long-pressed.
  ///
  /// If this callback and [onPressed] are null, then the button will be disabled.
  ///
  /// See also:
  ///
  ///  * [enabled], which is true if the button is enabled.
  final VoidCallback? onLongPress;

The field onPress is required but can be null according to the documentation. This allow to have a disabled effect.
This code work fine :
MaterialButton(onPressed: null);

I think you just have to change your onPress in SignInButton class to :
   //required
  /// [onPressed] Send a function to trigger the button.
  Function? onPressed;

yes I know, but this improvement causes some buttons to disappear and only their icons to appear. Not a good use. If you have a solution for this, you can open pr.

Alright, I'll take a look and test on my own to find a solution. 👌

Thanks for your contribution.
You can now upgrade to version 2.0.1

You're welcome, it was a pleasure 😄


TV mode switcher

As someone using a TV as a 3rd monitor, I'm experiencing a lof of issues with this:

It's not possible to detect whether the TV is turned on or in sleep mode (either by poking the video or sound output), the solutions will require some sort of manual intervention, likely a keyboard, which is acceptable.
The switcher should toggle between TV on / TV off, it would maybe be appropriate to have TV on / TV focused / TV off or have 2 different switchers. The TV focused mode would make the TV HDMI audio output the default and force new windows to appear on the TV.
TV on should activate the display, its position should be remembered which isn't the case now. TV off disables the display.
The TV uses the Digital Stereo (HDMI 3) Output Pulseaudio profile but this profile often switches back to HDMI 2. Switching to TV mode should make sure that this profile is used (it should be configurable of course)
A desktop notification should appear when modes are switched.
A GUI to configure all this would be nice to have but not a necessity.
If TV focus is not used, new windows should appear on the current primary monitor, even when the TV is the left most display.

Techs used: xrandr, pulseaudio, twinview, nvidia-settings, xorg

Might be worth a look: https://github.com/mk-fg/python-pulse-control

I was thinking about a Gnome Shell extension for this one. There are already a few ones that manage displays such as this one: https://github.com/bodedejavu/gnome-shell-extensions
@ikeydoherty would this work for Budgie as well?

Budgie isn't compatible with GNOME Shell, it has a native C API/ABI.

You should probably have a look at xset as it should be able to do what you want... if I understand the issue correct. At least when it comes to normal monitors. Not sure when it comes to TV's. I don't know how one would do this on Wayland though.

@ikeydoherty that kinda rules out the Javascript option (but the pulsectl python module already ruled it out before that and Pulseaudio doesn't have gi bindings). I got pretty much everything I need to use sorted out, now I have to put the pieces together.
@shellkr A few weeks back, I've looked at a bunch of tools that could detect if my TV was turned on or if it was in sleep mode and apparently, my TV doesn't support that feature (my main monitor does). I'll be using  libgnomedesktop which is what the Gnome Control Panel uses for display configuration (+ some Pulseaudio stuff).
Also, anything Wayland related is currently excluded from any Shellac related project. I consider Wayland to be experimental, incomplete and not ready for general use.


Merge pull request #2 from ColemanCox/master

turning in Koans 5.2

https://github.com/ColemanCox/5.2-koans/pull/3


fix: ioutil deprecation warning

os.CreateTemp is a drop-in replacement for the deprecated ioutil.TempFile. See https://pkg.go.dev/io/ioutil#TempFile.

Thanks! Not sure why CI didn't catch this, that's fixed in 477361079a08380287cba68aec3d9482c960310c.


CLI: Windows 10 profile with username incl. space causes errors

Repro steps

Use Windows 10 profile with a username which includes a space. e.g. "Jane Doe".
Install CLI like described here: https://www.npmjs.com/package/azure-functions-cli
Start function: func run Func1 -f file.json

Expected behavior
I assume the local server should start and execute the function code, but it has never worked for me. (see https://github.com/Azure/azure-webjobs-sdk-script/issues/822)
Actual behavior
The following error dialog shows up:

This means: The path could not be found. Verify that you used the correct name and repeat the procedure.
CLI shows the following:

Known workarounds
Use a profile with a username without spaces.

See also https://github.com/Azure/Azure-Functions/issues/52


MAGICDRAW-754

This pull request fixes 2 alerts - view on lgtm.com
fixed alerts:

2 for Possible confusion of local and field

Comment posted by lgtm.com


Global option to generate repo names which strip ABI version.

I am vendoring elasticmq in our mono repo to get FIFO queue features from a wip branch. I'd like to upstream the BUILD file, minus WORKSPACE or a bazel-deps setup. Since this is a simple library a repositories macro is a bit over the top.
The build files in a library repo should be universally includable in other repos -- this means referencing the jars  directly and not via the alias layer.  Currently the repo names are mangled with the scala ABI version reducing the "universally includable" aspect. Switching the ABI version shouldn't require the build files to change.
So, A global scala option to alter the repo naming scheme to strip off the ABI version would be useful for these situations.
@johnynek As discussed in #154 you are leaning to one scala ABI version workspace wide so I think this should be ok ?

This, to me, seems like a harder problem than we know how to solve here. Some open issues:

we don't have an agreement on how to map maven coordinates onto bazel workspace names. I have argued for an invertable embedding, but others are more willing to through caution to the wind and use a lossy embedding. This would need to be solved.
If we do the above, scala binary ABI version does appear in the name because that is how scala encodes it into maven.
if we have people pointing to maven jars, presumably unversioned since locally you might have a different version, we still destroy the ability to do use the "replacements" feature. If we I have replaced a jar with a local target, I won't have that jar, and won't want it to exist in a remote repo.

How will you test your upstreaming of the BUILD files? This seems pretty challenging to solve all the issues here.
Our current approach is to have the aliasing layer, then workspace.bzl actually wires up the aliases. Those should be composable, and indeed are now: you can get the full list of the versions you need and what aliases need to be set up and do that in skylark code in your own repo by loading the workspace.bzl file from the remote repo and getting the list of dicts that declare the deps.
To me, composing in skylark with actual data-structures seems like a better path than finding a way to agree on a global encoding of maven into bazel names, although, I hope the community can still do that. That said, it seems no one is actively working on it, and since google does not use a lot of external dependencies (or maybe any), it seems the bazel team has not moved much on this issue in the past 3 years.


Shortcut for pause/resume camera

Suggested on mod portal:

Would it be possible to add a keyboard shortcut for pausing/resuming the currently selected camera, without having to go through the GUI?
Pausing avoids making lots of identical screenshots at larger base sizes when I'm tinkering in a small area that is barely even visible, but doing it manually gets tedious and prone to mistakes.

Nice idea. I do not know how this would work with multiple camera's...
Enabling/disabling all with the same shortcut would be easy enough to implement.
But what would happen if one camera was already disabled and the 'enable/toggle shortcut' is used? Would it also enable this camera, or not?
I'll have to think about it a little (and find some time to update the mod :wink:)

Nice idea. I do not know how this would work with multiple camera's...
Enabling/disabling all with the same shortcut would be easy enough to implement.
But what would happen if one camera was already disabled and the 'enable/toggle shortcut' is used? Would it also enable this camera, or not?
I'll have to think about it a little (and find some time to update the mod :wink:)

I decided on a shortcut (button) that (un)pauses all cameras, as a sort-of global override.
You can put it in the toolbar (to see the current state of this toggle) or use a (custom) shortcut (if you toolbar is full with other tools already)


Add another troubleshooting resolution step

Under the Troubleshooting section, another bullet needs to be added for If Temporary Access Pass sign in was blocked due to User Credential Policy appears during sign-in with TAP, check the following:

The user is in scope for the TAP policy.

I was able to issue a TAP for a general user as a Global Admin that was not in scope for TAP. When the user tried to sign in they were prompted with the TAP login flow but after entering the TAP an error was displayed "Temporary Access Pass sign in was blocked due to User Credential Policy" and prompted for security key (previously registered) and password options to sign in.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5eeab12d-7578-3f86-4461-10603274408b
Version Independent ID: f4911928-14be-ecf6-0b02-cc80871ae365
Content: Configure a Temporary Access Pass in Azure AD to register Passwordless authentication methods
Content Source: articles/active-directory/authentication/howto-authentication-temporary-access-pass.md
Service: active-directory
Sub-service: authentication
GitHub Login: @InbarckMS
Microsoft Alias: justinha

@git14
Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.

@git14 thanks for the suggestion. This is added.

#please-close


src/utils/aux is an invalid filename on Windows

Windows refuses to create files or directories with reserved names like aux.  The tragically-long list of reserved characters and names is here or at Wikipedia.
Reported at http://seqanswers.com/forums/showthread.php?t=61998
See also samtools/htslib@9b1cb948e78a51b93473fc1dbd5e05a9c5fddf8b and samtools/htsjdk@ca1fe528af80d53e49bbe7cd40035b2fa7c77729 :smile:

Yikes, I had no idea. Will patch it for 2.25.0. Thanks for the report and the detailed explanation!

I have also encounter this.

Thanks so much for reporting this. Fixed with e0e4e5d9be1c.


RuntimeError: expected mat1 and mat2 to have the same dtype, but got: float != c10::BFloat16

In the Gemma 7b notebook, when rslora and dora are active, and the settings for 4-bit and 8-bit are off with r=8 and alpha=16, I encounter an error as described below. I have targeted all linear layers with lora and trained in the alpaca format. This issue does not occur every time. I am uncertain about what triggers it, but it seems that the main cause is the activation of dora. While I believe the training process is fine, I receive the following error during inference via Unsloth. However, when I switch to another inference engine, the error disappears.

RuntimeError                              Traceback (most recent call last)
 in <cell line: 14>()
12 from transformers import TextStreamer
13 text_streamer = TextStreamer(tokenizer)
---> 14 _ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 512)
20 frames
/usr/local/lib/python3.10/dist-packages/peft/tuners/lora/layer.py in _apply_dora(self, x, lora_A, lora_B, scaling, active_adapter)
214         mag_norm_scale = (magnitude / weight_norm).view(1, -1)
215         result_dora = (mag_norm_scale - 1) * (
--> 216             F.linear(x, transpose(weight, self.fan_in_fan_out))
217         ) + mag_norm_scale * lora_B(lora_A(x)) * scaling
218
RuntimeError: expected mat1 and mat2 to have the same dtype, but got: float != c10::BFloat16

@hcsolakoglu Yep it's most likely DoRA - since currently Unsloth doesn't support it technically, so inference is breaking probably

@hcsolakoglu Yep it's most likely DoRA - since currently Unsloth doesn't support it technically, so inference is breaking probably

Training with Dora is compatible with Unsloth, correct? I assume that only the inference phase has this problem?

@hcsolakoglu Hmm yes it's compatible, but ye its just the inference phase - I'll probs add a check

Same issue with DPO:
max_seq_length = 1024 # Supports automatic RoPE Scaling, so choose any number.
compute_dtype = getattr(torch, "float16")
Load model
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "unsloth/mistral-7b-v0.3",
# torch_dtype= compute_dtype,
max_seq_length = max_seq_length,
device_map="auto",
dtype = None, # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+
load_in_4bit = True, # Use 4bit quantization to reduce memory usage. Can be False.
# token = "hf_...", # use one if using gated models like meta-llama/Llama-2-7b-hf
)
model = model.to(compute_dtype)
Do model patching and add fast LoRA weights
model = FastLanguageModel.get_peft_model(
model,
r = 16,
target_modules = ["q_proj", "k_proj", "v_proj", "o_proj",
"gate_proj", "up_proj", "down_proj",],
lora_alpha = 16,
lora_dropout = 0, # Dropout = 0 is currently optimized
bias = "none",    # Bias = "none" is currently optimized
use_gradient_checkpointing = True,
random_state = 3407,
)
training_args = DPOConfig(
output_dir="/opt/data/enrichment/StructuredInformationExtraction/models/dpo/",
beta=0.1,
run_name = "dpo",
max_length= 1024,
max_prompt_length=512,
per_device_train_batch_size=4,
gradient_accumulation_steps=1,
gradient_checkpointing=True,
learning_rate=6e-6,
num_train_epochs=1,
report_to="wandb",
)
dpo_trainer = DPOTrainer(
model,
ref_model=None,
args=training_args,
train_dataset=train_ds,
tokenizer=tokenizer,
)
dpo_trainer.train()

Wait you forgot to set fp16 = True or bf16 = True in the trainer

I had a similar error training codellama, and adding bf16=True to SFTConfig (I am using SFTTrainer) solved it.
A check for this would be helpful. The exact same code ran well before swapping out a PEFTModel with the unsloth equivalent.

Apologies on the delay! Yes an auto marker is what I was hoping for - I'll see what I can do

I set fp16=True, but still got this issue:
return bwd(*args, **kwargs)
File "/workspace/miniconda3/envs/unsloth_env/lib/python3.10/site-packages/unsloth/kernels/fast_lora.py", line 116, in backward
d_downA = h.t() @ (dY @ downB.t())
RuntimeError: expected mat1 and mat2 to have the same dtype, but got: c10::Half != float

Also confirm ... no matter what model was used at LoRA training, but it cause:
/env/lib/python3.12/site-packages/unsloth/kernels/fast_lora.py", line 116, in backward
    d_downA = h.t() @ (dY @ downB.t())
RuntimeError: expected mat1 and mat2 to have the same dtype, but got: c10::Half != float

full error

File "", line 374, in _fast_inner_training_loop
File "", line 65, in _unsloth_training_step
File "/env/lib/python3.12/site-packages/accelerate/accelerator.py", line 2246, in backward
loss.backward(**kwargs)
File "/env/lib/python3.12/site-packages/torch/_tensor.py", line 581, in backward
torch.autograd.backward(
File "/env/lib/python3.12/site-packages/torch/autograd/init.py", line 347, in backward
_engine_run_backward(
File "/env/lib/python3.12/site-packages/torch/autograd/graph.py", line 825, in _engine_run_backward
return Variable._execution_engine.run_backward(
File "/env/lib/python3.12/site-packages/torch/autograd/function.py", line 307, in apply
return user_fn(self, *args)
File "/env/lib/python3.12/site-packages/torch/amp/autocast_mode.py", line 511, in decorate_bwd
return bwd(*args, **kwargs)
File "/env/lib/python3.12/site-packages/unsloth_zoo/gradient_checkpointing.py", line 158, in backward
torch.autograd.backward(output, dY)
File "/env/lib/python3.12/site-packages/torch/autograd/init.py", line 347, in backward
_engine_run_backward(
File "/env/lib/python3.12/site-packages/torch/autograd/graph.py", line 825, in _engine_run_backward
return Variable._execution_engine.run_backward(
File "/env/lib/python3.12/site-packages/torch/autograd/function.py", line 307, in apply
return user_fn(self, *args)
File "/env/lib/python3.12/site-packages/torch/amp/autocast_mode.py", line 511, in decorate_bwd
return bwd(*args, **kwargs)
File "/env/lib/python3.12/site-packages/unsloth/kernels/fast_lora.py", line 116, in backward
d_downA = h.t() @ (dY @ downB.t())
~^~~~~~~~~
RuntimeError: expected mat1 and mat2 to have the same dtype, but got: c10::Half != float

pip list

accelerate==1.0.1
torch==2.5.1
unsloth==2024.11.5
unsloth_zoo==2024.11.4

train params

train
--stage sft
--do_train True
--model_name_or_path Qwen/Qwen2.5-0.5B
--preprocessing_num_workers 16
--finetuning_type lora
--template qwen
--flash_attn auto
--use_unsloth True
--dataset_dir data
--dataset judment_train
--cutoff_len 2048
--learning_rate 5e-05
--num_train_epochs 3.0
--max_samples 100000
--per_device_train_batch_size 2
--gradient_accumulation_steps 8
--lr_scheduler_type cosine
--max_grad_norm 1.0
--logging_steps 5
--save_steps 100
--warmup_steps 0
--packing False
--report_to none
--output_dir saves/Qwen2.5-0.5B/lora/
--bf16 True
--plot_loss True
--ddp_timeout 180000000
--optim adamw_torch
--lora_rank 8
--lora_alpha 16
--lora_dropout 0
--lora_target all

Also research a bit for "solution" and find something like this: https://github.com/huggingface/diffusers/issues/6879

/env/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 116, in forward
return F.linear(input, self.weight, self.bias)
RuntimeError: expected mat1 and mat2 to have the same dtype, but got: c10::Half != float

#https://github.com/huggingface/diffusers/issues/6879#issuecomment-2014897651

@nupurkmr9 Thank you so much for your reply! I changed mixed_precision: 'fp16' to mixed_precision: 'no' in the configuration of the accelerate module, and I got to train successfully with the validation prompt. I hope this also helps @rezkanas


Add permissions to run jmap and jstat with sudo to work correctly.

Made these changes in order to get this to work on the QA boxes.  Surely there is a better way to do this, or is this ok?

Sorry, please disregard.  Didn't mean to do that PR against master.


The custom .clang-format file is not working

Version confirmation

[X] Confirm

Following prerequisites

[X] Confirm

Neovim version
NVIM v0.10.0-dev-951+g5d8ab32f3-Homebrew
Branch info
main (Default/Latest)
Minimal (user) folder structure required to reproduce the issue
lua/modules/configs/completion/formatters

Minimal config with steps on how to reproduce the issue
I have made the following changes in clang_format.lua:
return {"-style=file"}

I used clang-format -style=google -dump-config > .clang-format to generate the .clang-format file, and I placed it in the root directory of the project. The directory structure is as follows.
├── .git
├── src
│   ├── xxx.cpp
├── .clang-format

However, when I use :wq it still doesn't work. Do you know what the issue might be?
Expected behavior
It should format correctly.
Additional information
No response

Use :w first and then quit because the format process takes some time.

Use :w first and then quit because the format process takes some time.

I also tried that, but it still doesn't work.

I've already checked out this PR and made the changes according to the instructions inside, but it still doesn't take effect

Does the file have unsolved errors?

I've already checked out this PR and made the changes according to the instructions inside, but it still doesn't take effect

I see. You edited the clang_format.lua under lua/modules/configs/completion/formatters. So it have nothing to do with the user customization based on wiki.

https://github.com/ayamir/nvimdots/assets/61657399/faed26fa-4349-4c02-81db-647d143b07d5

This issue may provide some insight.

I see. You edited the clang_format.lua under lua/modules/configs/completion/formatters directly. So it has nothing to do with the user customization based on wiki.

I have moved clang_format.lua to user/configs/formatters. The original formatters directory was empty.
Additionally, I've updated the content inside clang_format.lua to return {"-style=file"}, but it still doesn't work.

Are there any issues reported by clang-format's YAML linter?

Sorry, I'm not sure how to view the YAML linter.

Sorry, I'm not sure how to view the YAML linter.

Try executing:
clang-format -Werror --dry-run --style=file <filename>

on the file you wish to format. Does clang-format report any error saying ... code should be clang-formatted?

yes

Can u start null-ls with debug logging and post the entire log file here?

Let null-ls start in debug mode:

=> set `debug = true` in `user/config/null-ls.lua`

Prune previous log files:

truncate -c -s 0 ~/.cache/nvim/null-ls.log ~/.cache/nvim/null-ls

Launch nvim and format the file causing this issue.
Debug logs are stored in either null-ls or null-ls.log under ~/.cache/nvim/.

I couldn't find the null-ls file in the user/config directory. I'm wondering if it's the same as in /modules/configs/completion. After making modifications, the content of the null-ls file is as follows:
[TRACE 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:97: starting null-ls client
[TRACE 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:106: received LSP request for method initialize
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/client.lua:152: unable to notify client for method textDocument/didOpen (client not active): {
  textDocument = {
    uri = "file:///Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp"
  }
}
[TRACE 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:131: received LSP notification for method initialized
[TRACE 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:131: received LSP notification for method textDocument/didOpen
[TRACE 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/generators.lua:21: running generators for method NULL_LS_DIAGNOSTICS_ON_OPEN
[DEBUG 六 11/11 15:50:35 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/generators.lua:24: no generators available
[TRACE 六 11/11 15:50:37 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:106: received LSP request for method textDocument/formatting
[TRACE 六 11/11 15:50:37 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/generators.lua:21: running generators for method NULL_LS_FORMATTING
[DEBUG 六 11/11 15:50:37 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/helpers/generator_factory.lua:321: spawning command "clang-format" at /Users/samapenguin/Desktop/GraphicsLearningHub with args { "-assume-filename", "/Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/src/main.cpp", "-style=file" }
[TRACE 六 11/11 15:50:38 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/helpers/generator_factory.lua:205: error output: /Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/.clang-format:174:1: error: unknown key 'RemoveParentheses'
RemoveParentheses: Leave
^~~~~~~~~~~~~~~~~
Error reading /Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/.clang-format: Invalid argument

[TRACE 六 11/11 15:50:38 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/helpers/generator_factory.lua:206: output: nil
[TRACE 六 11/11 15:50:38 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/helpers/generator_factory.lua:210: ignoring stderr due to generator options
[TRACE 六 11/11 15:50:38 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:131: received LSP notification for method textDocument/didSave
[TRACE 六 11/11 15:50:38 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/generators.lua:21: running generators for method NULL_LS_DIAGNOSTICS_ON_SAVE
[DEBUG 六 11/11 15:50:38 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/generators.lua:24: no generators available
[TRACE 六 11/11 15:50:44 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:106: received LSP request for method shutdown
[TRACE 六 11/11 15:50:44 2023] /Users/samapenguin/.local/share/nvim/site/lazy/null-ls.nvim/lua/null-ls/rpc.lua:131: received LSP notification for method exit

Have you updated clang-format in :Mason? This error did come from clang-format's YAML linter:
/Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/.clang-format:174:1: error: unknown key 'RemoveParentheses'
RemoveParentheses: Leave
^~~~~~~~~~~~~~~~~
Error reading /Users/samapenguin/Desktop/GraphicsLearningHub/oneWeekend/.clang-format: Invalid argument

The RemoveParentheses style option came with LLVM 17.1.

thx, you are right


when I convert pytorch model to caffe model ,this warnings appear

/usr/local/lib/python3.6/dist-packages/torch/onnx/utils.py:365: UserWarning: ONNX export failed on ATen operator reshape because torch.onnx.symbolic.reshape does not exist
.format(op_name, op_name))
/usr/local/lib/python3.6/dist-packages/torch/onnx/symbolic.py:65: UserWarning: ONNX export failed on GRU because batch_first not supported
warnings.warn("ONNX export failed on " + op + " because " + msg + " not supported")
Traceback (most recent call last):
File "/usr/local/bin/mmtoir", line 10, in
sys.exit(_main())
File "/usr/local/lib/python3.6/dist-packages/mmdnn/conversion/_script/convertToIR.py", line 192, in _main
ret = _convert(args)
File "/usr/local/lib/python3.6/dist-packages/mmdnn/conversion/_script/convertToIR.py", line 92, in _convert
parser = PytorchParser(model, inputshape[0])
File "/usr/local/lib/python3.6/dist-packages/mmdnn/conversion/pytorch/pytorch_parser.py", line 89, in init
self.pytorch_graph.build(self.input_shape)
File "/usr/local/lib/python3.6/dist-packages/mmdnn/conversion/pytorch/pytorch_graph.py", line 146, in build
output_shape = [int(x.replace('!', '')) for x in output_shape_str.split(',')]
File "/usr/local/lib/python3.6/dist-packages/mmdnn/conversion/pytorch/pytorch_graph.py", line 146, in
output_shape = [int(x.replace('!', '')) for x in output_shape_str.split(',')]
ValueError: invalid literal for int() with base 10: ''

It seems relative to this issue. However, we only support pytorch 0.4 now.


Release v0.2.1

Release 0.2.1
Accumulated changes:

medialibrary-125 Create simple example documentation
medialibrary-127 Consider deprecating random_sample_list()
medialibrary-128 Plot string has trailing whitespace
medialibrary-131 Post validation style tweeks
medialibrary-118 Validation tool should work at the media level
medialibrary-109 README.md should reflect location of distribution on PyPi
medialibrary-106 Repo: Skip directories based on presence of ignore file

Pull requests:
https://github.com/cjcodeproj/medialibrary/pull/137
https://github.com/cjcodeproj/medialibrary/pull/138

Closing notes:
There was an issue with the new Python build environment.  The new readme_renderer module requires Rust, which came as a surprise.  I was able to circumvent the issue by reverting to an older version.


Overhaul intro tutorial

WIP, description coming

closing for #6286; this one was doing too many things at once.


[web] Update run from CLI

Closes #1778

@gyorb No, we do not have any format limitation for the run names.

When I give -n an existing run name, I still can see a stack trace. But apart from that it looks good to me.

 Here is an overview of what got changed by this pull request:

Issues
======
- Added 2

Clones added
============
- web/tests/functional/cmdline/test_cmdline.py  2

See the complete overview on Codacy

 Here is an overview of what got changed by this pull request:

Issues
======
- Added 2

Clones added
============
- web/tests/functional/cmdline/test_cmdline.py  2

See the complete overview on Codacy

 Here is an overview of what got changed by this pull request:

Clones added
============
- web/tests/functional/cmdline/test_cmdline.py  2

See the complete overview on Codacy

 Here is an overview of what got changed by this pull request:

Clones added
============
- web/tests/functional/cmdline/test_cmdline.py  2

See the complete overview on Codacy


Building zigmod r91 from source leads error "no field named 'path' in union 'Build.LazyPath'"

Using zig version 0.13.0 and the r91 zigmod tarball leads to
$ zig build -j1
/private/tmp/zigmod-20240903-11789-hrjx2c/zigmod-r91/build.zig:14:33: error: no field named 'path' in union 'Build.LazyPath'
        .root_source_file = .{ .path = "src/main.zig" },
                                ^~~~
/usr/local/Cellar/zig/0.13.0/lib/zig/std/Build.zig:2171:22: note: union declared here
pub const LazyPath = union(enum) {
                     ^~~~~

I see that the nightly CI uses zig 0.12.0.

yes master still uses Zig 0.12.0 atm. update to 0.13.0 is coming soon

this is now fixed with https://github.com/nektro/zigmod/releases/tag/r92