dns cache manager: lookup cache by name

Commit Message: dns cache manager - lookup cache by name
Additional Description: the existing lookup function, which requires a config object, is not ergonomic in places where synthesizing such a config is convoluted.
Risk Level: low - new API
Testing: new unit tests
Signed-off-by: Jose Nino<EMAIL_ADDRESS>Co-Authored-By: Mike Schore<EMAIL_ADDRESS>

we want to have a config example of this working, as I am concerned it will fail identical config checks as-is.

@alyssawilk I wanted to make sure to address your comment. I am not sure I understand the scenario you are concerned about? The getCache function is sure to dedup caches with the same name and different config, and the holding data structure is a map keyed by name. So a lookup by name is ensured to either return a cache if it exists, or nullptr if it doesn't.

Well first I wanted a test so you're good there :-)
second I'm wondering where we'll create the cache by name and not have config?
As long as it's really clear that one place we create (with full config) and one place we consume, it's fine.  I'd been concerned we were going to use this to dedup the dns caches for say multiple DFPs at which point it wouldn't work but I'm assuming you have some other use case, and feel free to merge away :-)

@alyssawilk I see. Yeah the new method is fully for consumption and not creation. I can add more in terms of docstrings. I am going to merge this to move Envoy Mobile forward. But can add more in a subsequent PR.


addSerialSendBuffer lib

@ArduinoBot

@ArduinoBot

@ArduinoBot

Hello @Jenifen. I see you have fixed the error reported by the bot. However, Library Manager works exclusively from Git tags, so the bot won't be able to see the fix you made until you create a new release or tag in the library repository.
If you look at the repository contents at the latest tag, you can see that the version the bot is checking still has the problem:
https://github.com/Jenifen/SerialSendBuffer/tree/v1.0.0
❗ Remember to update the version field in the library's library.properties file as needed before making a release/tag.
Once you have done that, simply mention @ArduinoBot in a comment here to trigger it to run the automated checks again. After those are passing, your library will automatically be added to Library Manager.
If you have any questions or concerns, please let me know.
Regards, Per

Hi @per1234 Thanks, done and I'm going to trigger it

@ArduinoBot

@ArduinoBot

@ArduinoBot


lineage - unable to link multiple pipelines to tables in one goal

Affected module
UI
Describe the bug
Lets say I have a pipeline that is airbyte -> postgres -> airflow. to create the lineage chart, I have to go to the airbyte pipeline & link the table to it and, once again, go to the airflow pipeline and link the table to it, so I will obtain the lineage mentioned. The problem with that is:

It damages the user experience to not be able to do everything in one go.
It it not that intuitive. For a moment I thought it would not be possible to create the lineage chart properly.
It would be good to have the possibility to do the lineage chart in one go.

To Reproduce

Expected behavior
A clear and concise description of what you expected to happen.
Version:
1.0.3
Additional context
Add any other context about the problem here.

Done with the new lineage UI changes.


Checkpointing fails if a key includes a forward slash

To reproduce:
import orbax.checkpoint

CHECKPOINT_DIR = "./checkpoints"
checkpointer = orbax.checkpoint.PyTreeCheckpointer()
tree = {"test/test": 42}
checkpointer.save(CHECKPOINT_DIR, tree)

Raises
FileNotFoundError: [Errno 2] No such file or directory: 'checkpoints.orbax-checkpoint-tmp-1690216561285472/test/test'

This is a problem in particular for haiku parameter names, which can include forward slashes by default.

Can't reproduce your issue on a public colab. Please make sure you're using the latest version of the orbax-checkpoint package. Full support for haiku style paths was added not that long ago, so you might have an old version.

You're right, I have orbax version 0.2.3. However it looks like pip install --upgrade orbax-checkpoint doesn't install the newer version―is it possible that the newer orbax versions don't support python 3.8?


Update Kubernetes proxy URLs

Fix https://github.com/apache/incubator-heron/issues/3404
Follow the Kubernetes proxy URLs documented here (Note that proxy is placed after the service name instead of /api/v1):

http://kubernetes_master_address/api/v1/namespaces/namespace_name/services/service_name[:port_name]/proxy

Note that the helm configuration file at https://storage.googleapis.com/heron-charts needs to be updated as well. Otherwise, users following the helm guide will not be able to get any stats from heron UI.

I believe the file has already been updated in this repository (see below), but the file at https://storage.googleapis.com/heron-charts was not changed for a while (The last modified time is 2018-04-18).
https://github.com/apache/incubator-heron/blob/d8db1c50b499c823e319fd16a4476a02f525a367/deploy/kubernetes/helm/templates/tools.yaml#L109-L115

I'm going to let this sit for a day and see if anyone else has any feedback.

I am not familiar with this part but the change looks reasonable. Thanks.
Please feel free to merge.


Added a non-bitcoin related project

I think it's worth taking a look at this project and weighing the strengths and weaknesses vs. BitAuth.


Add support for bridge interface type

Example for configuration inside Vagrantfile:
test_vm1.vm.network :public_network, :dev => "br0", :mode => 'bridge',
:type => "bridge", :model_type => "e1000"

This was never documented. :frowning:


Open new file with custom extension

Hi there :)
I like to configure a default language/file extension for opening new files.
So, Ctrl+N should result in syntax highlighting and optionally LSP support in the specified language.
I already issued this at the Lite XL repo, and got some information on how this could be implemented, so I simply link this here:
It's likely that I will implement this myself, and ask for help. 👍🏻

I did not even know realise i needed this!

It is especially useful, with the current language being copied.
So you open a new file from a PHP file, its a PHP file.
You are in a Python file, you open a Python file.
VSCode has this already integrated.


added Newton Leipnik

Codecov Report

:exclamation: No coverage uploaded for pull request base (docs@5485e51). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             docs      #16   +/-   ##
=======================================
  Coverage        ?   88.94%
=======================================
  Files           ?        7
  Lines           ?      606
  Branches        ?        0
=======================================
  Hits            ?      539
  Misses          ?       67
  Partials        ?        0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5485e51...dc12720. Read the comment docs.


refactor: better giveaways

Functionally LGTM. Need to look into coverage targets & testing the code in Discord.


Added Build Submission

Added File Repo

@aslams2020 kindly merge this pull request!

@aslams2020 Thank you!


[AutoDiff] Enable class method differentiation.

Class members (methods, accessors, constructors) with @differentiable attributes now have vtable entries.
Class member JVPs/VJPs are required to be final to simplify the semantics of overriding JVP/VJP declarations.
Extend differentiation transform to emit JVPs/VJPs for class_method instructions.
Resolves TF-631.
Todos regarding class differentiation support at TF-37.

Example:
class Super {
  @differentiable(wrt: x, jvp: jvpf, vjp: vjpf)
  func f(_ x: Float) -> Float {
    return 2 * x
  }
  final func jvpf(_ x: Float) -> (Float, (Float) -> Float) {
    return (f(x), { v in 2 * v })
  }
  final func vjpf(_ x: Float) -> (Float, (Float) -> Float) {
    return (f(x), { v in 2 * v })
  }
}

class SubOverride : Super {
  @differentiable(wrt: x)
  override func f(_ x: Float) -> Float {
    return 3 * x
  }
}

class SubOverrideCustomDerivatives : Super {
  @differentiable(wrt: x, jvp: jvpf2, vjp: vjpf2)
  override func f(_ x: Float) -> Float {
    return 3 * x
  }
  final func jvpf2(_ x: Float) -> (Float, (Float) -> Float) {
    return (f(x), { v in 3 * v })
  }
  final func vjpf2(_ x: Float) -> (Float, (Float) -> Float) {
    return (f(x), { v in 3 * v })
  }
}

func classValueWithGradient(_ c: Super) -> (Float, Float) {
  return valueWithGradient(at: 1) { c.f($0) }
}
expectEqual((2, 2), classValueWithGradient(Super()))
expectEqual((3, 3), classValueWithGradient(SubOverride()))
expectEqual((3, 3), classValueWithGradient(SubOverrideCustomDerivatives()))

Extends work by @marcrasi in https://github.com/apple/swift/pull/24975.

@swift-ci Please test tensorflow

This LGTM as is, but we should add leak checking tests specially for cases that would trigger calling through the newly added thunk.

Added leak-checking tests for vtable entry thunks in https://github.com/apple/swift/pull/26050/commits/2f0dee8e94994622c884a41f3034a29520fb9e78.

@swift-ci Please test tensorflow

@swift-ci Please test tensorflow

@swift-ci Please test tensorflow linux

@swift-ci Please test tensorflow linux

@swift-ci Please test tensorflow linux

Merging https://github.com/apple/swift/pull/26050 to unblock progress, happy to address feedback later.
Todos regarding class differentiation are documented at TF-37.
Thanks to reviewers and thanks @marcrasi for the original prototype!


Improve SSR doc for Remix

This PR improve the SSR doc of Remix.

Thanks for the PR! Mind signing the CLA so we can get the build passing?

Done.

GET_BUILD

GET_BUILD

@LFDanLu
I:

rebased this PR on main branch.
made a little fix on the quotation marks (" -> ').

GET_BUILD


Phone number field in Boosted ?

Prerequisites

[x] I have searched for duplicate or closed feature requests
[x] I have read the contributing guidelines

Proposal
Good day
I'm searching an example in Boosted that I could refer to developers to illustrate the correct use of a phone field with country selector.
In Design System we have apparently this that might be used for forms : https://system.design.orange.com/0c1af118d/p/88ab5b-forms/b/599459/i/48901789

Do you have also - if not yet existing in Boosted - a recommendation regarding library to use/good practice ?
Motivation and context
We are currently reviewing some journeys related to eShop funnel.
In those funnels, we are currently asking in most of cases for local/national number... but with eSims we need to consider possible tourists/diaspora that might not have a local contact number and need to fill in a foreign number.

Hello @MathieuPomm,
I don't think we have more information than you about this subject. For instance, as a starting point, I would go for https://github.com/jackocnr/intl-tel-input that seems quite close to what we want in Orange.
If you find any other cool open-source library about this subject, feel free to write it down somewhere around here and maybe explain how you implemented it.

Thanks @louismaximepiton (ans sorry for the answer delay).
After confirmation, we are already using this library in our portals (for forms), so thanks for confirmation, we will pursue to use it, notably in funnel.
Do not hesitate to let us know when this component might be available in Boosted (if it will be).
We could consider this request treated
Brgds


Metadata json file addit endpoint

Following merged PR #390 for TEST
Go hand in hand with https://github.com/hubmapconsortium/gateway/pull/280

Replaced by #394


Restrict access to data sets dependent on user

When data for multiple sign languages are entered, we need to be able to restrict access for users to specific languages. Perhaps by adding a list of data sets as a separate pane in the admin/users or admin/groups interface?

See https://github.com/Signbank/FinSL-signbank/issues/180

For export_csv, this should be working because the Gloss List query now restricts the results to the selected datasets, or if none are selected, to those the user is allowed to view. The export_csv exports the results of the query.

The import_csv only allows import into the datasets the user has access to.

The code for Gloss Detail also only allows setting / updating to datasets the user has access to.

Curiousity, there is no display of the Dataset when inside the Morpheme Detail View, yet in the Datasets pulldown menu Available Datasets where it shows the datasets the user has access to, the counts shown include both glosses and morphemes.
So it's not entirely clear how a morpheme's dataset gets set.

Ah, it seems the Edit button in the Morpheme Detail view isn't working.

Okay, the Edit button has been repaired.

I should have made this explicit right from the start, but now Susan made me aware: both glosses and morphemes should belong to datasets! And so everything we do for glosses should also happen for morphemes (restricting access, specifying for dataset, visualising, enforcing specification on CSV import, listing in CSV export, ...).

Adding a morpheme from the morpheme search page does require the user to select a dataset.
So far so good.

Morpheme search wasn't using datasets. Now it is. (Not live as of this writing.)

I added object permission check for the morpheme detail view.
I also made the checking of permissions a bit more strict: before the global permission used and tje global 'view_dataset' permission was enough to view all datasets. Now, only the object permission are used.

Way cool, man. 8-)
Any open ends here, or can we close this issue?

I think we need to check the CSV import/export. Hold on.

OK, exporting a morpheme CSV seems to be correct.

Importing an CSV is for staff or members of the group Publisher only. That goes for both morphemes and glosses, as far as I can see. No, dataset permission are involved. What say you, @ocrasborn ?

Ah! That's not good. Any dataset editor should be able to import CSV files to be able to batch change data. I don't see a permission that I can assign myself to a group though, is that right?
And after assigning it to Editors, please link it to data set object permission 'edit'.

Now, for each row in the CSV the dataset is checked against the list of datasets the user has the 'change_dataset' permission for.

👍


Add RichTextBlock support to Block Kit Kotlin DSL builder

This PR adds RichTextBlock support to Block Kit Kotlin DSL builder. With this changes, we can now use DSL like:
withBlocks {
    richText {
        richTextSection {
            text("Check out these different block types with paragraph breaks between them:\n\n")
        }
        richTextPreformatted {
            text("Hello there, I am preformatted block!\n\nI can have multiple paragraph breaks within the block.")
        }
        richTextSection {
            text("\nI am rich text with a paragraph break following preformatted text. \n\nI can have multiple paragraph breaks within the block.\n\n")
        }
        richTextQuote {
            text("I am a basic rich text quote, \n\nI can have multiple paragraph breaks within the block.")
        }
        richTextSection {
            text("\nI am rich text with a paragraph after the quote block\n\n")
        }
        richTextQuote {
            text("I am a basic quote block following rich text")
        }
        richTextSection {
            text("\n")
        }
        richTextPreformatted {
            text("I am more preformatted text following a quote block")
        }
        richTextSection {
            text("\n")
        }
        richTextQuote {
            text("I am a basic quote block following preformatted text")
        }
        richTextSection {
            text("\n")
        }
        richTextList {
            style(ListStyle.BULLET)
            richTextSection {
                text("list item one")
            }
            richTextSection {
                text("list item two")
            }
        }
        richTextSection {
            text("\nI am rich text with a paragraph break after a list")
        }
    }
}

Category (place an x in each of the [ ])

[ ] bolt (Bolt for Java)
[ ] bolt-{sub modules} (Bolt for Java - optional modules)
[ ] slack-api-client (Slack API Clients)
[x] slack-api-model (Slack API Data Models)
[x] slack-api-*-kotlin-extension (Kotlin Extensions for Slack API Clients)
[ ] slack-app-backend (The primitive layer of Bolt for Java)

Requirements
Please read the Contributing guidelines and Code of Conduct before creating this issue or pull request. By submitting, you agree to those rules.

Sign our CLA; without it, we are unable to accept any external contribution

@seratch About CLA - I'm experiencing the same issue of https://github.com/slackapi/java-slack-sdk/pull/1364#issuecomment-2338727587. Can you check it?

Thanks!

As a workaround, I closed and reopend this PR to let the CLA bot check it again. It seems your status is now correctly updated!

Oops, let me correct myself about the merge timing, we'll release this patch release before it: https://github.com/slackapi/java-slack-sdk/milestone/108 After that, this enhancement will be included in an upcoming minor release.


feat: non-production dependency checking

Add support for not passing the --production flag through to the license-checker library.
The default behaviour has not changed, but the command now optionally supports --environment=all and --environment=development to pass the relevant flags to license-checker.
I went with this flag because if we were to mirror the flags of license-checker it would change the default behaviour.
Open to suggestions for other naming, alternatively we could add a --no-production flag.

Thanks for the PR! I'll look into this soon.

Thanks for your patience on this, we actually put someone on it, but they were/are running a windows environment which caused some complications so we got sidetracked with that. It's still on my list!


Pt 2d integration

This is done using the new TensorFlattener API in https://github.com/pytorch/pytorch/pull/85039
To enable it:  import spdm.fsdp and use spdm.fsdp.is_available() to check if it's working.

I hope it is not too inconvenient, but I am renaming TensorFlattener to FSDPExtensions after receiving feedback from FSDP side since the name is more reflective. I am cleaning up the unit tests a bit and will push soon. There will be no semantic changes.
I can ping you once I have pushed.

I hope it is not too inconvenient, but I am renaming TensorFlattener to FSDPExtensions after receiving feedback from FSDP side since the name is more reflective. I am cleaning up the unit tests a bit and will push soon. There will be no semantic changes.
I can ping you once I have pushed.

Can't never complaint about better naming. <3 for leading the effort on getting the extensions merged into PT.


Support for services/replica sets

Looking at the code, it seems this only supports labelling Deployments as victims: https://github.com/asobti/kube-monkey/blob/6a1c7df307481dd9165a54b0e27d2c244b283be2/victims/factory/deployments/eligible_deployments.go#L50
Any plans to support services/replica sets? Is there a workaround if we don't use deployments?
EDIT: I thikn I can just add the label selector to pods and have it work, is that correct: https://github.com/asobti/kube-monkey/blob/b42263d09f5825a25c4bbfb74cafbbe6d4aba589/victims/victims.go#L113

kube-monkey currently supports Deployments and StatefulSets. Daemonsets support is still missing.
I chose not to support replica sets as Kubernetes recommends using Deployments over Replica sets

While ReplicaSets can be used independently, today it’s mainly used by Deployments as a mechanism to orchestrate pod creation, deletion and updates. When you use Deployments you don’t have to worry about managing the ReplicaSets that they create. Deployments own and manage their ReplicaSets.

https://kubernetes.io/docs/concepts/workloads/controllers/replicaset/
As for Services, a Kubernetes service is merely a load balancing tool, and does not have any pods, so kube-monkey cannot target a service.

@asobti thanks for the quick response. Love the idea with this tool.
I agree deployments are preferred however our current production env uses RS. And I would like to avoid taking on the task of migrating. This is mostly due to us deploying via spinnaker where RS are the preferred targets.
Thanks for the answer 👍


Provide Direction Option for Collapse Plugin

Square has a really nice "Browse" navigation that collapses upward on a mobile device (Note: You may not be able to see this feature if you are shrinking down your browser to mobile size). I'm proposing that the collapse plugin take a direction option that would allow you to choose how you want the menu / navigation to collapse:
$("#myCollapsible").collapse({
  toggle: true,
  direction: "up"
});

We could probably reserve an additional CSS class for those who aren't familiar with JavaScript. Perhaps .collapse-up?
I reviewed all issues tagged as features and didn't find any requesting what I'm looking for.

Bin expired. cant see its js. Other people might need this too please update. Thanks!
"This bin was created anonymously and its free preview time has expired"

@fat Your fiddle on 28 Aug 2014 isn't loading anymore. :) Can you provide me your solution again?


Added return of actual operation in LogiLEDWrapper

Related to: #1953

List any issues that this PR fixes: fixes # , etc...

This pull request proposes the following changes:

The wrapper returns the actual operation status combined with the init status. This gives the application the chance to check if the device and/or Logitech software is still present.

Known issues/To do:

I dont understand what you're trying to solve here? The wrapper is for logitech games, not devices. This is never used for connecting to LGHUB or LGS from Aurora. The purpose of the wrapper is acting as a replacement to LGS to the eyes of, for example, GTA 5. This allows aurora to capture the lighting intended for logitech devices and display it somewhere else.

If you lose connection to the device or GHub/LGS the wrapper doesn't return an appropriate result. The LogitechLed gives back the right status, this change is meant to be consistent.

This issue does not solve #1953 at all but the wrapper changes do make sense...
I'll take the opportunity to fix an issue i found with the wrapper light event while testing the changes.
Thank you for contributing.


spatialdata_xenium_explorer.write

Hi SOPA team,
Thanks for this excellent work!
Would you help me to convert zarr format into xenium-like format using spatialdata_xenium_explorer.write function?
I have Nanostring Cosmx dataset in format spatialdata like SpatialData tutorial

It is possible to visualize cosmx data using the Xenium Explorer?
If 1 is possible, cosmx data has the attribute called labels in stead of shapes, can you handle it?
How about the arguments "gene_column" in spatialdata_xenium_explorer.write function in my case?

Thank you for your help,
Chuang

Hello @Chuang1118, thanks for your interest in spatialdata_xenium_explorer and sopa!

We still have some difficulties with CosMX data because the image needs to be stitched (i.e., creating one image based on all the FOVs), see this issue. Actually, we should be able to convert each single FOV separately, but this is not very helpful, so I have to work on this stitching to be able to really support CosMX data.

For that, you can refer to this function of Sopa that will geometrize the cells for you, for instance:

from sopa.segmentation import shapes
from shapely import affinity

# mask is a numpy array of cell-ids per pixel, similar to your labels (see API documentation)
cells = shapes.geometrize(mask)

# xmin and ymin are the min coordinate of the bounding box of your FOV
cells = [affinity.translate(cell, xmin, ymin) for cell in cells]

# Now the cells are polygons in the global pixel coordinate system

This is not very easy to use for now, but everything will be simplified when we will be able to stitch CosMX data: then, you'll be able to directly use the full Sopa toolbox.

gene_column is the name of the column that contains the genes names in each of the dataframes (for instance, you can look at sdata.points['1_points'] to see which column contains the genes names).

I'll let you know when I make progress about CosMX data. Meanwhile, I hope this helps!

Thanks a lot for the quick response!

I deeply appreciate your effort to stitch multiple FOV. Currently, I work with CosMx TMA(Tissue Micro-array) data, I don't have this problem.
In my opinion, this point is only link to handle stitching issue. In my case, I don't have to have xmin and ymin to define the cells within a given FOV.

My point is there are different data type(Labels & Shapes) through CosMx and Xemium/Merfish technologies, even though both them are SpatialData format. More details:
CosMx:
SpatialData object with:

├── Images
│     ├── '1_image': SpatialImage[cyx] (3, 3648, 5472)
│     ├── '2_image': SpatialImage[cyx] (3, 3648, 5472)
│     ├── '3_image': SpatialImage[cyx] (3, 3648, 5472)

├── Labels
│     ├── '1_labels': SpatialImage[yx] (3648, 5472)
│     ├── '2_labels': SpatialImage[yx] (3648, 5472)
│     ├── '3_labels': SpatialImage[yx] (3648, 5472)

└── Points
      ├── '1_points': DataFrame with shape: (3593716, 9) (2D points)
      ├── '2_points': DataFrame with shape: (2589915, 9) (2D points)
      ├── '3_points': DataFrame with shape: (2303614, 9) (2D points)

Xemium/Merfish:
Do you have any idea to convert attribute Labels into Shapes?
SpatialData object with:
├── Images
│     └── 'rasterized': SpatialImage[cyx] (1, 522, 575)
├── Points
│     └── 'single_molecule': DataFrame with shape: (3714642, 3) (2D points)
├── Shapes
│     ├── 'anatomical': GeoDataFrame shape: (6, 1) (2D shapes)
│     └── 'cells': GeoDataFrame shape: (2399, 2) (2D shapes)
└── Table
      └── AnnData object with n_obs × n_vars = 2399 × 268
    obs: 'cell_id', 'region'
    uns: 'spatialdata_attrs': AnnData (2399, 268)
with coordinate systems:
▸ 'global', with elements:
        rasterized (Images), single_molecule (Points), anatomical (Shapes), cells (Shapes)

There is sdata.points['10_points'] output, I don't see any columns contain the genes names.

Thanks a lot for your help,
Chuang

Okay great, so it means that each FOV corresponds to one sample, right? This simplifies everything!
Concerning the gene_column, it is indeed "target": for instance if you do sdata["10_points"]["target"].compute(), you should get the gene names.

Note that we are using Dask, which is using lazy-loading, which is why you can't see the genes until you use .compute(). The purpose is RAM efficiency, since big slides are usually too big to fit in memory.

Here is a snippet to convert one FOV to the xenium explorer (in this example, I convert FOV=1). Note that you'll need Sopa, not only spatialdata_xenium_explorer, because it is needed to convert the labels to shapes.
import spatialdata
import sopa.io
from sopa.segmentation import shapes, StainingSegmentation
from sopa.segmentation.aggregate import Aggregator

### Read the CosMX data
sdata = spatialdata.read_zarr("cosmx_io.zarr") # the sample from the SpatialData tutorial
sdata = sdata.filter_by_coordinate_system("1") # get only the first FOV
del sdata.table # we delete the table because we will re-compute a new table below

### Transform labels to shapes
cells = shapes.geometrize(sdata["1_labels"].values)
StainingSegmentation.add_shapes(sdata, cells, image_key="1_image", shapes_key="1_shapes")

### Compute a new table
aggr = Aggregator(sdata, image_key="1_image", shapes_key="1_shapes")
aggr.update_table(gene_column="target", average_intensities=False)

### Convert to Xenium Explorer. The outputs will be saved in the "cosmx_xenium_explorer" directory
sopa.io.write("cosmx_xenium_explorer", sdata, gene_column="target")

Then, double-click on the cosmx_xenium_explorer/experiment.xenium file, it should open it in the Xenium Explorer!

Hello,
Yes, one TMA corresponds to one capture, there are non-continuous both the FOVs.
Thanks for your advice, I will try it, then give you feedback.

Unfortunately, your code doesn't work for me.
StainingSegmentation.add_shapes(sdata, cells, image_key="1_image", shapes_key="1_shapes")

This line crashes both my dataset and the SpatialData tutorial's dataset(cosmx_io.zarr). I have got same error.
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Cell In[7], line 1
----> 1 StainingSegmentation.add_shapes(sdata, cells, image_key="1_image", shapes_key="1_shapes")

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/sopa/segmentation/stainings.py:181](http://<IP_ADDRESS>:1237/lab/tree/PMLAB/USERS/Active/Chuang_DONG/scRNAseq/cosmx_230417_h_AITL/2_Analysis/V1/SpatialData/~/miniconda3/envs/sopa/lib/python3.10/site-packages/sopa/segmentation/stainings.py#line=180), in StainingSegmentation.add_shapes(cls, sdata, cells, image_key, shapes_key)
    178 geo_df.index = image_key + geo_df.index.astype(str)
    180 geo_df = ShapesModel.parse(geo_df, transformations=get_transformation(image, get_all=True))
--> 181 sdata.add_shapes(shapes_key, geo_df, overwrite=True)
    183 log.info(f"Added {len(geo_df)} cell boundaries in sdata['{shapes_key}']")

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/spatialdata/_core/spatialdata.py:1273](http://<IP_ADDRESS>:1237/lab/tree/PMLAB/USERS/Active/Chuang_DONG/scRNAseq/cosmx_230417_h_AITL/2_Analysis/V1/SpatialData/~/miniconda3/envs/sopa/lib/python3.10/site-packages/spatialdata/_core/spatialdata.py#line=1272), in SpatialData.add_shapes(self, name, shapes, overwrite)
   1267 def add_shapes(
   1268     self,
   1269     name: str,
   1270     shapes: GeoDataFrame,
   1271     overwrite: bool = False,
   1272 ) -> None:
-> 1273     _error_message_add_element()

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/spatialdata/_utils.py:281](http://<IP_ADDRESS>:1237/lab/tree/PMLAB/USERS/Active/Chuang_DONG/scRNAseq/cosmx_230417_h_AITL/2_Analysis/V1/SpatialData/~/miniconda3/envs/sopa/lib/python3.10/site-packages/spatialdata/_utils.py#line=280), in _error_message_add_element()
    280 def _error_message_add_element() -> None:
--> 281     raise RuntimeError(
    282         "The functions add_image(), add_labels(), add_points() and add_shapes() have been removed in favor of "
    283         "dict-like access to the elements. Please use the following syntax to add an element:\n"
    284         "\n"
    285         '\tsdata.images["image_name"] = image\n'
    286         '\tsdata.labels["labels_name"] = labels\n'
    287         "\t...\n"
    288         "\n"
    289         "The new syntax does not automatically updates the disk storage, so you need to call sdata.write() when "
    290         "the in-memory object is ready to be saved.\n"
    291         "To save only a new specific element to an existing Zarr storage please use the functions write_image(), "
    292         "write_labels(), write_points(), write_shapes() and write_table(). We are going to make these calls more "
    293         "ergonomic in a follow up PR."
    294     )

RuntimeError: The functions add_image(), add_labels(), add_points() and add_shapes() have been removed in favor of dict-like access to the elements. Please use the following syntax to add an element:

	sdata.images["image_name"] = image
	sdata.labels["labels_name"] = labels
	...

The new syntax does not automatically updates the disk storage, so you need to call sdata.write() when the in-memory object is ready to be saved.
To save only a new specific element to an existing Zarr storage please use the functions write_image(), write_labels(), write_points(), write_shapes() and write_table(). We are going to make these calls more ergonomic in a follow up PR.

My debugging refer to stainings.py line 166
print(sopa.__version__)

1.0.7
cells = shapes.geometrize(sdata["1_labels"].values)
len(cells) # 2303
cells[:10]

[<POLYGON ((778 3632.364,<PHONE_NUMBER>.496,<PHONE_NUMBER>.821,<PHONE_NUMBER>.82...>,
<POLYGON ((944 3634.364,<PHONE_NUMBER>.887,<PHONE_NUMBER>.977, 1012.885 3646.9...>,
<POLYGON ((1590.96 3619.83, 1603.364 3646.821, 1661.636 3646.821, 1664.934 3...>,
<POLYGON ((1666 3629.845, 1665.063 3639.188, 1669.722 3646.917, 1710.912 364...>,
<POLYGON ((1817 3613.364, 1817.598 3621.496, 1831.2 3635.224, 1836.917 3645....>,
<POLYGON ((2188.519 3614.614, 2188.083 3633.278, 2194.247 3645.221, 2228.196...>,
<POLYGON ((2228.519 3600.614, 2231.292 3646.196, 2283.636 3646.821, 2294.402...>,
<POLYGON ((2505 3635.615, 2505.42 3642.2, 2511.088 3646.976, 2614.387 3647, ...>,
<POLYGON ((2607.497 3617.342, 2622.181 3646.979, 2713.278 3646.917, 2717.688...>,
<POLYGON ((3364.002 3624.497, 3367.272 3641.887, 3372.364 3646.821, 3424.912...>]
image = get_spatial_image(sdata, "1_image")
image

geo_df = gpd.GeoDataFrame({"geometry": cells})
geo_df.index = "1_image" + geo_df.index.astype(str)
geo_df = ShapesModel.parse(geo_df, transformations=get_transformation(image, get_all=True))
geo_df

sdata.add_shapes("1_shapes", geo_df, overwrite=True)

In the final, I got same error messages. I don't understand why add_shapes return None.

Which version of spatialdata are you using?
Just a guess: have you installed spatialdata in editable mode on the main branch? If yes, then can you install any recent released version of spatialdata (no editable mode)?
Else, can you try older versions of spatialdata, like 0.0.15?
I'll dig through it on Wednesday

Previous Results : sopa == 1.0.7 & spatialdata==0.1.1
Today, I have installed the older releases sopa. i.e. v1.0.6, v1.0.5 and v1.0.1, I have got issue#37.
Then, I have installed spatialdata==0.0.16 based on sopa == 1.0.7
pip install --force-reinstall -v "spatialdata==0.0.16"

there are some warnings:
sopa 1.0.7 requires botocore==1.34.19, but you have botocore 1.31.17 which is incompatible.
sopa 1.0.7 requires spatialdata>=0.1.1, but you have spatialdata 0.0.16 which is incompatible.
I am following your given snippet.
I have modified import sopa.io to import sopa, because import sopa.io I got issue#37.
ImportError                               Traceback (most recent call last)
Cell In[24], line 1
----> 1 import sopa.io

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/sopa/io/__init__.py:4]
      2 from .explorer import write, align
      3 from .standardize import write_standardized
----> 4 from .transcriptomics import merscope, xenium, cosmx
      5 from .histopathology import wsi, wsi_autoscale
      6 from .report import write_report

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/sopa/io/transcriptomics.py:18]
     16 import dask.dataframe as dd
     17 import numpy as np
---> 18 import spatialdata_io
     19 import xarray
     20 from dask import array as da

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/spatialdata_io/__init__.py:12]
     10 from spatialdata_io.readers.visium import visium
     11 from spatialdata_io.readers.visium_hd import visium_hd
---> 12 from spatialdata_io.readers.xenium import (
     13     xenium,
     14     xenium_aligned_image,
     15     xenium_explorer_selection,
     16 )
     18 __all__ = [
     19     "curio",
     20     "visium",
   (...)
     30     "visium_hd",
     31 ]
     33 __version__ = version("spatialdata-io")

File [~/miniconda3/envs/sopa/lib/python3.10/site-packages/spatialdata_io/readers/xenium.py:32]
     30 from spatial_image import SpatialImage
     31 from spatialdata import SpatialData
---> 32 from spatialdata._core.query.relational_query import _get_unique_label_values_as_index
     33 from spatialdata._types import ArrayLike
     34 from spatialdata.models import (
     35     Image2DModel,
     36     Labels2DModel,
   (...)
     39     TableModel,
     40 )

ImportError: cannot import name '_get_unique_label_values_as_index' from 'spatialdata._core.query.relational_query'

There is very strange import sopa works only time, I got sdata like below:
SpatialData object with:
├── Images
│     └── '1_image': SpatialImage[cyx] (3, 3648, 5472)
├── Labels
│     └── '1_labels': SpatialImage[yx] (3648, 5472)
├── Points
│     └── '1_points': DataFrame with shape: (<Delayed>, 9) (2D points)
├── Shapes
│     └── '1_shapes': GeoDataFrame shape: (7797, 1) (2D shapes)
└── Table
      └── AnnData object with n_obs × n_vars = 7797 × 1010
    obs: 'region', 'slide', 'cell_id', 'area'
    uns: 'sopa_attrs', 'spatialdata_attrs'
    obsm: 'spatial': AnnData (7797, 1010)
with coordinate systems:
▸ '1', with elements:
        1_image (Images), 1_labels (Labels), 1_points (Points), 1_shapes (Shapes)
▸ 'global', with elements:
        1_image (Images), 1_labels (Labels), 1_points (Points), 1_shapes (Shapes)
▸ 'global_only_image', with elements:
        1_image (Images), 1_shapes (Shapes)
▸ 'global_only_labels', with elements:
        1_labels (Labels), 1_points (Points)

This result is not reproducible, because I have re-run import sopa, I have got issue#37. and I can't write xemium-like format due to import spatialdata_io issue.

hi,
In my opinion, since
RuntimeError: The functions add_image(), add_labels(), add_points() and add_shapes() have been removed in favor of dict-like access to the elements. Please use the following syntax to add an element:

	sdata.images["image_name"] = image
	sdata.labels["labels_name"] = labels
	...

by using the new syntax e.g. sdata.shapes["1_shapes"]=geo_df, in this way, I can update the attribute.
This issue has also an impact on aggregate.py aggr.update_table(gene_column="target", average_intensities=False)
would you tell me more about these 3 lines of code, how to rebuild Table(Anndata)?
del sdata.table # we delete the table because we will re-compute a new table below

### Compute a new table
aggr = Aggregator(sdata, image_key="1_image", shapes_key="1_shapes")
aggr.update_table(gene_column="target", average_intensities=False)

Hello @Chuang1118,
All these issues were related to recent SpatialData updates, made just before their paper's publication.
I needed to update some things in sopa, which should now be stable if you update to sopa==1.0.9.
So, if you run pip install sopa --upgrade, you should now have sopa==1.0.9, spatialdata>=0.1.2 and spatialdata-io>=0.1.2
The snippet above remains the same! Let me know if you are still having issues.
Sorry again for these instabilities, SpatialData should now be more stable, and so will be Sopa 🙂

NB: sopa is up-to-date, but spatialdata_xenium_explorer also needs updates. In the meantime, please stay with sopa (the conversion to the xenium explorer is the same).

Hello,
I confirm that this is resolved by sopa==1.0.9. Then I can use Xenium Explorer version 2.0.0 to visualize experiment.xenium.
Thanks again for developing such a wonderful tool.

Great!
Note that Sopa supports interoperability with the Xenium Explorer:

Export new cell categories/clusters to the Xenium Explorer: here
Align images: here
Use the lasso tool from the Xenium Explorer and go back to the SpatialData object: here

All this will be better detailed in a future tutorial :)


Invalid shouldComponentUpdate in ErrorBoundary

Describe the bug
Was cleaning up the code after changing the linting rules and found ErrorBoundary.shouldComponentUpdate to not make any sense:
shouldComponentUpdate(nextProps: Readonly<any>, nextState: Readonly<any>): boolean {
  return nextState.error !== nextProps.error
}

According to the Props type, there is no error prop. I think it's supposed to be the following where it checks if the error changed:
shouldComponentUpdate(nextProps: Readonly<Props>, nextState: Readonly<State>): boolean {
  return nextState.error !== this.state.error
}

This mistake was most likely made due to the overuse of Any. In general, that's one criticism of this template: You aren't strict enough with typings and disable a lot of linting rules that should prevent that. Though it's still a very useful template so thanks for creating it 👍
Ignite version
8.4.0
Additional info
none needed

Submitted the PR. 👍
In my case, I changed the linting and typing rules to be stricter (and use the Airbnb style) and fixed all the resulting errors.  Properly implementing strict typings would definitely take some more refactoring so I understand how it's not worth it for you guys. Though if implemented properly I don't think it would slow down development but it would require more TypeScript know-how.

:tada: This issue has been resolved in version 8.4.5 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


The preprocessing convert the images to 224x224, can we do higher resolution?

When we compare the similarity between higher resolution images, e.g. 512x512 or 1k x 1k, downsampling to 224 will cause losing of details. Is there any way to compare between higher resolutions and how do you estimate the impact of DreamSim score, as the models were pretrained on 224 x 224 and haven't seen higher-res images? Thanks

Hi -- great question. At the moment DreamSim can be run with higher resolutions, but is trained on 224x224 images (as are the CLIP/DINO backbones). We are working on variants that are calibrated for higher resolutions and will update this issue when we have them up and running!


Road Roller does not work with Custom Designs

Placing and removing custom designs with the Road Roller tool appears to work in Poker, but the changes are ignored in-game, refreshing the Road Roller tool reveals that the changes are ignored.
I have tried to restart the game to apply changes with no luck. All other features with the Road Roller tool still work as intended.

Restarting the console sorted it. I'm not sure if you want to look into the cause of the issue but for anyone with the same problem just restart the console.


.jsx extension loading error

In case if I change Footer.js to Footer.jsx, the next error appear:
Module not found: Error: Can't resolve '../Footer' in '/home/me/code/projects/web/test/components/Layout'
 @ ./components/Layout/Layout.js 20:0-31
 @ ./src/home/index.js
 @ ./src/routes.json
 @ ./src/main.js
 @ multi react-hot-loader/patch webpack-hot-middleware/client !style-loader!css-loader!react-mdl/extra/material.min.css react-mdl/extra/material.min.js ./main.js

Could you help me with this, please?

just start using file extension during require or import
for example require('./Footer.jsx') instead of require('./Footer')

Thanks, it was the matter of changing extensions in .json files also.

The best solution is add below config to /tools/webpack.config.js
const config = {
  ...

  resolve: {
    extensions: ['.js', '.jsx']
  },

  ...
}


Replace minikube with k3d in local k8s cluster examples

We use minikube to spin up local clusters in our guides to deploying locally with Kubernetes. For example, our "Orchestrate a Local Cluster with Kubernetes" guide references minikube. Instead, our SRE team prefers using k3d as it is lightweight and fast compared to minikube.
We should update our docs to follow the best practice recommendations from our SRE team.

Per @keith-mcclellan the various K8s emulators have pros/cons for different use cases, and we should discuss (maybe with SREs) which we want to recommend on our public docs.


Insert co_posonlyargcount into args

Until this is done you get this error:
Traceback (most recent call last):
  File "/home/tabulate/snek.py", line 4, in <module>
    def main():
  File "/home/tabulate/.local/lib/python3.9/site-packages/goto.py", line 240, in with_goto
    _patch_code(func_or_code.__code__),
  File "/home/tabulate/.local/lib/python3.9/site-packages/goto.py", line 231, in _patch_code
    return _make_code(code, _array_to_bytes(buf))
  File "/home/tabulate/.local/lib/python3.9/site-packages/goto.py", line 58, in _make_code
    return types.CodeType(*args)
TypeError: an integer is required (got type bytes)

This is because types.CodeType started requiring another argument, posonlyargcount. If you use the inspect module, you can see the arguments needed for this function.
>>> import types
>>> import inspect
>>> print(inspect.getdoc(types.CodeType))
code(argcount, posonlyargcount, kwonlyargcount, nlocals, stacksize,
      flags, codestring, constants, names, varnames, filename, name,
      firstlineno, lnotab[, freevars[, cellvars]])

Create a code object.  Not for the faint of heart.

I got this error using Python 3.9, and after adding this it works again

Closing because of #22

code.replace(co_code=codestring)

u r so fking awesome!


HIVE-27620 : Backport of HIVE-25945: Upgrade H2 database version to 2.1.210

JIRA link - https://issues.apache.org/jira/browse/HIVE-27620

@sankarh @dengzhhu653 @vihangk1 Can you please review and merge this


[Templates] Add ISO8601 {week} number template

I split my tasks into separate notes in a "{year}-W{week} Tasks" template, where the week is padded to 2 numbers by default (so e.g. 2023-W09 Tasks.md).
At first I thought about opening the new feature request, but I managed to do it on my own, and so I present this solution. Additionally, now notePath (for file to append tasks to) goes through applyTemplates(), so it can work in my use case.
There is a tiny bit of a existing code refactor – if this is unwanted, let me know!

Hey @AdamAdamsMusic code looks great, thanks! I'll run it tomorrow or the next day just to confirm.
Add your Raycast name to the manifest in package.json too if you want.

@AdamAdamsMusic Can you doublecheck your Raycast username? The build is failing:
https://github.com/raycast/extensions/pull/7435/files#annotation_12481953831

Sorry for that! Turns out it's case-sensitive - should work now!


[AutoRelease] t2-containerservice-2022-08-17-59465(Do not merge)

https://github.com/Azure/sdk-release-request/issues/2985
Live test success
https://dev.azure.com/azure-sdk/internal/_build?definitionId=982

issue link:https://github.com/Azure/sdk-release-request/issues/2985


Can't build with Xcode 8 Beta 6

I'm trying to use Just in an iOS 10 message extension. Due to various issues, Cocoapods isn't working for me, so I've tried dropping in Just.swift, but I get a whole mess of compile errors, some I don't feel confident about fixing.
Has Swift 3 syntax changed since your last build?

One example
public lazy var headers:CaseInsensitiveDictionary<String,String> = {
    return CaseInsensitiveDictionary<String,String>(dictionary: (self.response as? HTTPURLResponse)?.allHeaderFields as? [String:String] ?? [:])
}()

produces the error Expression type '[String : String]? is ambiguous without more context, on the return line.

This works...
public lazy var headers:CaseInsensitiveDictionary<String,String> = {
if let httpResponse = self.response as? HTTPURLResponse {
let headerFieldsDict = httpResponse.allHeaderFields as NSDictionary? as? [String:String]
return CaseInsensitiveDictionary<String,String>(dictionary: headerFieldsDict ?? [:])
}
return [:]
}()
https://forums.developer.apple.com/message/169819#169819

I have fixed all the other compile errors, will try to check in my version to you after I see if it works.

Thank you. Master should work with Xcode 8 GM now.


chore(deps): use smoldot 1.0

After migrating from https://github.com/paritytech/smoldot to https://github.com/smol-dot/smoldot, the package name has changed from smoldot to smoldot2.
This PR removes the deprecated package and replaces it with the new version.

@lrazovic your changes are good but the deno-deploy does not deploy it.
I'll keep investigating how to configure it properly.
FYI, I created a PR to double check how works when the deploy succeeds

Thanks for the update @kratico. The culprit seems: https://github.com/paritytech/capi/blob/d9852dc803831ddde4aaae3e601f929637d580f7/server/capi.dev/delegator.ts#L108 It doesn't find any deployments so the _getDeploymentUrl never returns a valid url and after 1 minute of trying the Action times out


Expose _process()'s delta parameter as block

This might be useful in some programs.
Draft because I don't like the text on the block.

IRL @dsd reckons that, regardless of text, the added complexity of giving this block a parameter is not worth it: this is a block that every learner will need to use.
He suggested we could have 2 blocks:

every frame
every frame, i'm an expert, with delta (text tbc)


Add property to disable table actions

Added the disabled property to the tableActions so to disable the option like in the px-dropdown. Sample data [{ name: , id: , disabled: boolean }]

@nirmaldandalaio : Could you please commit with your github id instead of the corporate id ?

Forked this with the GE github account as well. So closing this pull request and opening a new one with a fork to my personal github account.


Add task ID pattern to notification skip criteria

Fixes

Fixes #953 by @AetherUnbound
Description

This PR adds an optional task_id_pattern field which can be used in the SILENCED_SLACK_NOTIFICATIONS Variable to specify a specific task within the DAG that a message should be silenced from.
This adds task_id as an optional parameter to the various slack.send_* functions, so that the new behavior is backwards compatible. I tried to add it as a required variable initially but the changeset would have required so many modifications to various DAGs and tasks that it became unnecessarily cumbersome. Instead, this now adds the task_id to all exception calls (e.g. the on_failure_callback issuances of send_alert), which should cover the error cases we usually want to silence at least. We're fortunate that the silencing infrastructure is so versatile that any message which attempts to get emitted to Slack can be silenced, the drawback is that we can't change the fundamentals of the functions without then changing all of those uses.
I also made some testing tweaks to make it clearer which parameter sets were failing in a given test.
Lastly, I updated the check_silenced_dags DAG to include the task ID pattern if it exists.
Testing Instructions

just test will show all of the new tests passing successfully.
To see how the new pattern is available, you can try running the check_silenced_dag DAG:

Add a new SILENCED_SLACK_NOTIFICATIONS variable with the following contents:

{
   "check_silenced_dags": [
        {
            "issue": "https://github.com/WordPress/openverse-catalog/issues/936",
            "predicate": "ValueError",
            "task_id_pattern": "check_silenced_dags_configuration"
        }
    ]
}

Run the DAG (you may need the GitHub PAT in order to have this run successfully)
Check the logs of the task to see a message similar to the following:

[2023-01-10, 23:37:53 UTC] {python.py:177} INFO - Done. Returned value was: The following DAGs have Slack messages silenced, but the associated issue is closed. Please remove them from the silenced_slack_notifications Airflow variable or assign a new issue.
  - <https://github.com/WordPress/openverse-catalog/issues/936|check_silenced_dags (check_silenced_dags_configuration): 'ValueError'>

Make the following edit to the check_silenced_dags.py file:

diff --git a/openverse_catalog/dags/maintenance/check_silenced_dags.py b/openverse_catalog/dags/maintenance/check_silenced_dags.py
index 17b3277a..b0c8384b 100644
--- a/openverse_catalog/dags/maintenance/check_silenced_dags.py
+++ b/openverse_catalog/dags/maintenance/check_silenced_dags.py
@@ -74,6 +74,7 @@ def get_dags_with_closed_issues(

 def check_configuration(github_pat: str):
+    raise ValueError("whoops!")
     silenced_dags = Variable.get(
         "SILENCED_SLACK_NOTIFICATIONS", default_var={}, deserialize_json=True
     )

Run the DAG and check the logs to make sure the following line is present:

[2023-01-11, 00:28:54 UTC] {slack.py:294} INFO - Skipping Slack notification for check_silenced_dags::check_silenced_dags_configuration.

Change the exception to a KeyError
Run the DAG again and check the logs to make sure "skipped slack message" line was issued (meaning it would have sent a notification)

Checklist

[x] My pull request has a descriptive title (not a vague title like
Update index.md).
[x] My pull request targets the default branch of the repository (main) or
a parent feature branch.
[x] My commit messages follow best practices.
[x] My code follows the established code style of the repository.
[x] I added or updated tests for the changes I made (if applicable).
[x] I added or updated documentation (if applicable).
[x] I tried running the project locally and verified that there are no visible
errors.
[x] I ran the DAG documentation generator (if applicable).

Developer Certificate of Origin

Developer Certificate of Origin
Developer Certificate of Origin
Version 1.1

Copyright (C) 2004, 2006 The Linux Foundation and its contributors.
1 Letterman Drive
Suite D4700
San Francisco, CA, 94129

Everyone is permitted to copy and distribute verbatim copies of this
license document, but changing it is not allowed.

Developer's Certificate of Origin 1.1

By making a contribution to this project, I certify that:

(a) The contribution was created in whole or in part by me and I
    have the right to submit it under the open source license
    indicated in the file; or

(b) The contribution is based upon previous work that, to the best
    of my knowledge, is covered under an appropriate open source
    license and I have the right under that license to submit that
    work with modifications, whether created in whole or in part
    by me, under the same open source license (unless I am
    permitted to submit under a different license), as indicated
    in the file; or

(c) The contribution was provided directly to me by some other
    person who certified (a), (b) or (c) and I have not modified
    it.

(d) I understand and agree that this project and the contribution
    are public and that a record of the contribution (including all
    personal information I submit with it, including my sign-off) is
    maintained indefinitely and may be redistributed consistent with
    this project or the open source license(s) involved.

Is there a docs page about how to use Slack in DAGs?

There's not a docs page specifically, but we do have documentation on how to use the Slack message builder. Almost all functions that use the slack module use either slack.send_message or slack.send_alert. I could add a note about that to the top of the Slack module if that'd be helpful? Or where else would you expect documentation like that to go?

Should the SILENCED_SLACK_NOTIFICATIONS variable be added to the .env file or through the Airflow UI or somewhere else?

Should the SILENCED_SLACK_NOTIFICATIONS variable be added to the .env file or through the Airflow UI or somewhere else?

We only use this "as needed" and it's not necessarily something that we'd care to persist constantly on dev, so it's something we'd edit through the UI (specifically the endpoint /variable/list/).

Yes, it should log the contents of the message regardless of whether the alert gets skipped!
https://github.com/WordPress/openverse-catalog/blob/af205795b412da9f3d0d7f6d7e066b7d039b1763/openverse_catalog/dags/common/slack.py#L295


chore: update rust-postgres fork

Proposal to rebase our rust-postgres fork with upstream changes, with many commits removed that were deemed proxy-only. https://github.com/neondatabase/rust-postgres/tree/neon-rebase1
Notable change from upstream tokio-postgres is that simple_query first returns a RowDecription, then secondarily returns a Row. A lot of neon code was assuming the first item would always be the first row.

Seems to be consistent e2e test failures. Will look into these.


Stock price prediction

Problem Description:
Developing a new machine learning model for improving the accuracy and performance of stock price predictions. The challenge lies in modeling the highly volatile nature of stock prices using various predictive factors like historical stock prices, market sentiment, trading volumes, and economic indicators.
Model Description:
The primary model will be based on Random Forest Regression, which is well-suited for handling complex datasets with nonlinear relationships. Along with Random Forest, we will also experiment with other models like Support Vector Machines (SVM)  and Long Short-Term Memory (LSTM) networks to compare their effectiveness.
Expected Outcome:
The goal is to enhance prediction accuracy for daily stock price trends, outperforming traditional methods and baseline models. The model will be validated against  historical datasets.
As a beginner to contributing in open source, please do assign me this issue under gssoc ext and hacktoberfest 2024, would be a great start for to both open source and a leap in AI/ML. Thank you.

Please Assign this task to me under gssoc-extd24 and hacktoberfest

Sure @Ittismita, do mention the estimate time that you will require.

@ananyagoyal1, please check other issues or create a new different one because this has been assigned.

Sure @Ittismita, do mention the estimate time that you will require.

Done 👍

Updates @Ittismita?

Updates @Ittismita?

So sorry for the delay.. been busy with some university stuff.... would surely submit the PR within the upcoming 2 days...


Revert "Switch to kube-system namespace for kubevirt manifests"

Subsequent discussion indicates this isn't the right approach, and that
we instead need to fix the manifest ordering, and/or use a temporary
script that runs after the cluster is fully deployed.
This reverts commit a52d2b31ae239becee39f2c882601d55801efd19.

Build SUCCESS, see build http://<IP_ADDRESS>:8080/job/dev-tools/173/

@hardys which ordering issue do you refer to? I think currently the main problem is that cluster deployment is abrupt by machine api operator baremetal mode not supported. Assuming this is fixed, which other (ordering?) issues do you envision?

@hardys which ordering issue do you refer to? I think currently the main problem is that cluster deployment is abrupt by machine api operator baremetal mode not supported. Assuming this is fixed, which other (ordering?) issues do you envision?

I just meant right now this doesn't work because we try to apply the manifests before the cluster is fully up - I wasn't 100% sure if by fixing the machine api operator baremetal type we can then be sure these manifests don't get applied until the cluster is fully deployed?
If we're confident that's the only fix needed then great, but I'm not super familiar with how the manifests are applied yet, so didn't want to assume it'd just work (again! ;)

@hardys agreed, perhaps it's my naive expectation that installer won't apply additional manifests before cluster is ready for that. ;)


Visual regression testing

Make sure these boxes are ticked before submitting a new issue:

[x] I have checked that this is not a duplicate
[x] I have added a label categorizing this under BLKN | Kiwicom | Icons | Global

Visual regression testing added in #469.


[Error] float division by zero

Hi,
when I run the script with the progress_handler I see the error message:
(env) [xxxx]$ /Users/[xxxx]/env/bin/python [xxxx]test_runner.py
Running: ffmpeg -y -i [xxxx] -c:a libmp3lame -y output.mp3 -loglevel verbose -progress pipe:1 -nostats
0%|                                                                                | 0/384.304 [00:00<?, ?s/s]
[Error] float division by zero
Exiting Better FFmpeg Progress.
The code below:
from better_ffmpeg_progress import FfmpegProcess
def handle_progress_info(percentage):
print(f"The FFmpeg process is {percentage}% complete. ETA is / seconds.")
process = FfmpegProcess(["ffmpeg", "-i", "[xxxx]", "-c:a", "libmp3lame", "-y", "output.mp3"], )
process.run(progress_handler=handle_progress_info)

better-ffmpeg-progress==2.0.5
ffmpeg-python==0.2.0
future==0.18.2
tqdm==4.64.1

What might be the issue is that the duration of your file was incorrectly determined to be 0, in which case division by 0 will occur on this line.
I'll add a conditional to only run (seconds_processed / self._duration_secs) * 100 if self._can_get_duration is True. I'll let you know when I have added this change, after which please upgrade to the latest version of better-ffmpeg-progress and let me know if this fixes the issue.

Can you upgrade to version 2.0.6 with pip3 install better-ffmpeg-progress --upgrade and let me know if this fixes the issue?


301 redirect /Haus to /haus

In case a user opens https://wort.schule/Polizei (with any number of capital letters) the system redirects the request with a 301 error code to https://wort.schule/polizei

As a hunch: we should downcase the word in app/services/slug_constraint.rb. That should make it case insensitive.
It wouldn't redirect to the "proper" URL though. That would require a bit more logic in the controllers.

It wouldn't redirect to the "proper" URL though. That would require a bit more logic in the controllers.

We have to do a proper 301 redirect here. If somebody opens https://wort.schule/Adler I don't want him/her to get the adler page I don't want the user to bookmark that page and I don't want a potential search engine to crawl it either. I want the system to redirect it to https://wort.schule/adler with a proper 301 HTTP redirect. THAT page can be bookmarked and that page can be crawled by search engines.


Readme code snippet typoed

fetchUserId().then { id in
    print("UserID : \(id)")
}.onError { e in
    print("An error occured : \(e)")
}.finally {M
    print("Everything is Done :)")
}

see }.finally {M

Thanks @iliaskarim, just fixed it :)


apply setup-py-upgrade

oh this was already started here https://github.com/jazzband/imaplib2/pull/19/files


Support logging of replayed historic data

Hi, nice application!
I was wondering if Saillooger also supports the logging of replayed data. For testing purposes at home (where i don't have a N2K network) i replay pre-recorded N2K data. In signalk-server i use a Filestream Data Source to feed this data in the various apps/plugins. But, this data is replayed with an old timestamp (so in my case from a trip in 2019).
In Saillogger i see that the connection is established, as the Last Contact field (in boats) is updated, and the positioning is displayed. But in Monitoring and in Logs the data is not shown.
Is it possible to record past journeys?
Btw.

when i use Data Source type "canboat" for Filestream the datastream, it sends out an "Invalid Date". When i use type "Multiplex" i do get the historic date. In both situations the result in Saillogger is the same as described above.
i am also sending data with the data of today (ship information and the temperature of the raspberry Pi). Maybe this confuses Saillogger, receiving two timestamps in the same stream.

It is not a big deal of course, it would help me in testing while not being at the boat.
Thanks.

Hi Bram, thank you! I didn't do anything specific to support "Replayed data" and didn't test it. I would expect it to work with some minor changes but it hasn't been on my priority list. Have you had a chance to test it with actual data yet?

Hi Ilker, yes i have tested it this weekend with actual data and it works quite well. But i do have some problems:

The first trip on Friday was logged ok, but the replay data was added to it, see https://saillogger.com/log/01186 (the first 100 miles was replayed data from Thursday), the part where i am sailing up the river was actual logged data).
Saturday, the second day, was logged correctly: https://saillogger.com/log/01201
Sunday, the third day, is not yet visible in the log overview. It was a trip to the North East (From Enkhuizen to Lemmer).

Hi Bram,
I think I have a better idea on what happened. On your first replayed trip, it probably didn't include 3 hours of data at your destination, is that correct? That would explain it because Saillogger would never detect that the trip actually ended (I will explain more below), adding that and the new sail together.
Here is the logic on detecting the end of a trip: Boat needs to report position from the ~same position for 3 hours or more. You can be at anchor, dock, etc. So for your Sunday sail, I suspect it showed up after your collector reported another position report after 3 hours (or whenever it connected to the Internet)?
This may look complex but here is the challenge. When a boat stops reporting position, Saillogger cannot differentiate between two very different scenarios: a) Did the boat actually stop and the collector/Internet connection got powered down (like docking your boat and powering down your electronics to go home) b) Is the boat still moving but it actually went out of Internet reception range (e.g. crossing an ocean)
Differentiating between (a) and (b) is non-trivial. So when something like this happens, Saillogger waits until it hears back from your collector again. In case of (a), it will hear back when you re-power your electronics, and position report will be the same/similar to the last one. In case (b), it will hear back when you "cross an ocean" (!) and get to Internet reception range again. In that case, of course the boat will be in a different spot.
All this is to say that, if you power down your electronics, it may take until your next time at the boat for that to pick up and log your sail. No worries though, it should show up.
Let me know if what you observed was contrary to this.

Thanks for the explanation, thats clear and indeed what happend. The first trip contains replay data which did not end exactly at the point that the next trip started, so there's no 3 hours recorded at the same location. And for the Sunday trip, that will probably show up next time.
My signalk-server directly shuts down as soon as i turn of the navigation instruments (which i normally do directly after arriving, also to save power). There is some time in this shutdown process, as it will cleanly shutdown using the SH-RPi  HAT. That will probably give me the opportunity to send a last shutdown 'status' message (using curl or so). That way your service can determine what to do (or let the user configure it). I would just set it to end the trip (if no data is received within a reasonable time span, an hour or so, or the 3 hours timeout.
This wouldn't be bullet proof either as there might be no mobile network reception for this last command, but for my area i expect this to work 95% of the time or more. Do you have an API endpoint that i can send a curl command to?
Happy to help to make this work.

Tacking on here - I'm looking for a way to fill in some of the other trips I've taken to make the log a little more complete. I wrote a script to populate the SQLite buffer with accurate-ish data and sent it through, however, no trip was created. I suspect that was because they were all historical timestamps and Saillogger may only process the most recent datapoints?
I disconnected the collector for a few days to make sure there'd be no new data, then refilled the buffer with data after the latest update, and retried. This time a trip was created successfully. Is there a cleaner way to do this or support for processing a historical log?


Update spec to reflect slashing

Currently the spec has no definition of slashing mechanics. A new "Slashing" subsection should be added under Stake, and the Stake/Arithmetic page should be updated to reflect the slashing penalty math.

This should be done as part of #375 ; categorizing it as duplicate


pip install manifest-ml[api] fails?

Description of the bug
deepspeed package has a dependency on py-cpuinfo
installing py-cpuinfo directly allows mainfest to install successfully
To Reproduce
pip install manifest-ml[api]
Expected behavior
I expected pip to confirm installation
Error Logs/Screenshots
If applicable, add error logs or screenshots to help explain your problem.
Environment (please complete the following information)

OS: OSX 14.2, Apple M1 Pro
Python 3.11.5

installing py-cpuinfo directly allows mainfest to install successfully


Implement authentication

As a start without any authorisation (which we should add later on) and probably based on OAuth 2.0

Implemented initially in #272


header-html and footer-html not showing

hello, i've been trying the header and footer options when converting html to pdf but i cant make this work.
this is a function i wrote trying to create a pdf and the imports from the package:
use mikehaertl\wkhtmlto\Pdf;
use mikehaertl\tmp\File;
class PDFBuilder {
public function generatePdf()
{
$pdf = new Pdf;
$this->generalOptions['header-html'] = "this is the footer of the pdf";
// $this->generalOptions['header-html'] = $this->headerContent; //also tried like this
$this->generalOptions['footer-html'] = new File($this->footerContent, '.html');
$pdf->setOptions($this->generalOptions);
$content = $this->bodyContent; //just some html from another file
$pdf->addPage($content, $this->pageOptions);
return $pdf->toString();
}
}
these are the options i inject from outside to the class in generalOptions:
$options = [
'no-outline',
'encoding' => 'UTF-8',
'margin-top'    => 0,
'margin-right'  => 0,
'margin-bottom' => 0,
'margin-left'   => 0,
'disable-smart-shrinking',
];
and i add the header and footer in the function
what i get is this:

please help me figure out what is wrong

If you pass the content as a string it must be valid HTML (i.e. it must start with <html>, see the regex here), otherwhise our library can't detect it.
I'd recommend not to use new File() directly as this is rather an internal class.
Apart from that I can not really help you much as your problem is more about how to use wkhtmltopdf and not our library. I would start with wkhtmltopdf on the command line first and try to start with very simple options (e.g. no styling, etc...) just to figure out how the header/footer options of wkhtmltopdf work.
I could imagine that margin=0 is also a problem as you leave no room for the headers - but not sure about it.


break from fork

Thanks for the PR! 🚀
Unfortunately it looks like some of our CI checks failed. See the Contributing Guide for details.

⚠check_whitespace
Failed whitespace check. More details below.

Checking for trailing whitespace
./terraform-google-cloud-storage/.github/workflows/linter.yaml:41:          token: ${{ secrets.CFT_ROBOT_PAT }}
Error: Trailing whitespace found in the lines above.
Checking for missing newline at end of file

⚠check_terraform
Failed Terraform check. More details below.

Running terraform fmt
Running terraform validate
terraform_validate ./terraform-google-cloud-storage
Error:
Reference to undeclared local value
 on main.tf line 23, in resource "google_storage_bucket" "buckets":
 23:   name          = "${
local.prefix
}${lower(element(var.names, count.index))}"
A local value with the name "prefix" has not been declared. Did you mean
"prefixs"?
Error:
Reference to undeclared local value
 on main.tf line 27, in resource "google_storage_bucket" "buckets":
 27:   labels        = merge(var.labels, { name = replace("${
local.prefix
}${lower(element(var.names, count.index))}", ".", "-") })
A local value with the name "prefix" has not been declared. Did you mean
"prefixs"?
terraform_validate ./terraform-google-cloud-storage/examples/multiple_buckets
Error:
Reference to undeclared local value
 on ../../main.tf line 23, in resource "google_storage_bucket" "buckets":
 23:   name          = "${
local.prefix
}${lower(element(var.names, count.index))}"
A local value with the name "prefix" has not been declared. Did you mean
"prefixs"?
Error:
Reference to undeclared local value
 on ../../main.tf line 27, in resource "google_storage_bucket" "buckets":
 27:   labels        = merge(var.labels, { name = replace("${
local.prefix
}${lower(element(var.names, count.index))}", ".", "-") })
A local value with the name "prefix" has not been declared. Did you mean
"prefixs"?
terraform_validate ./terraform-google-cloud-storage/examples/simple_bucket
Success!
The configuration is valid.
terraform_validate ./terraform-google-cloud-storage/modules/simple_bucket
Success!
The configuration is valid.
terraform_validate ./terraform-google-cloud-storage/test/fixtures/multiple_buckets
Error:
Reference to undeclared local value
 on ../../../main.tf line 23, in resource "google_storage_bucket" "buckets":
 23:   name          = "${
local.prefix
}${lower(element(var.names, count.index))}"
A local value with the name "prefix" has not been declared. Did you mean
"prefixs"?
Error:
Reference to undeclared local value
 on ../../../main.tf line 27, in resource "google_storage_bucket" "buckets":
 27:   labels        = merge(var.labels, { name = replace("${
local.prefix
}${lower(element(var.names, count.index))}", ".", "-") })
A local value with the name "prefix" has not been declared. Did you mean
"prefixs"?
terraform_validate ./terraform-google-cloud-storage/test/setup
Warning:
google_project_services is deprecated - many users reported issues with dependent services that were not resolvable.  Please use google_project_service or the https://github.com/terraform-google-modules/terraform-google-project-factory/tree/master/modules/project_services module.  It's recommended that you use a provider version of 2.13.0 or higher when you migrate so that requests are batched to the API, reducing the request rate. This resource will be removed in version 3.0.0.
 on .terraform/modules/project/terraform-google-project-factory-3.3.1/modules/core_project_factory/main.tf line 165, in resource "google_project_services" "project_services_authority":
165: resource "google_project_services" "project_services_authority"
{
Success!
The configuration is valid, but there were some validation warnings as shown above.


Fix junction for vesteria on z0 rail

It was part of the LBCL, but became orphaned when I renovated the z0 rail

The guys over at lambat say it's okay to remove this station, because there's nothing there anymore.


Adds OpenAIConversationalAgent

This commit adds a new file OpenAIConversationalAgent.py to the src/backend/langflow/components/agents directory. The ConversationalAgent class is a custom component that represents a conversational agent capable of using OpenAI's function calling API.
The ConversationalAgent class has the following features:

It inherits from the CustomComponent class.
It has a display_name attribute set to "OpenaAI Conversational Agent".
It has a description attribute set to "Conversational Agent that can use OpenAI's function calling API".
It implements the build_config method to define the configuration options for the agent.
It implements the build method to create an instance of the AgentExecutor class, which represents the agent's execution environment.
The build method takes several parameters, including model_name, tools, memory, system_message, and max_token_limit.
It uses the ChatOpenAI class from the langchain.chat_models module to create an instance of the OpenAI language model.
It uses the ConversationTokenBufferMemory class from the langchain.memory.token_buffer module to handle conversation history and token buffering.
It uses the OpenAIFunctionsAgent class from the langchain.agents.openai_functions_agent.base module to create an instance of the OpenAI functions agent.
It returns an instance of the AgentExecutor class with the agent, tools, memory, verbose, and return_intermediate_steps parameters set.

📝 feat(init.py): add empty init.py file to the agents directory
This commit adds an empty __init__.py file to the src/backend/langflow/components/agents directory. The __init__.py file is necessary to make the agents directory a Python package.

is this still in beta version?


an issue for the "MambaBlock" in "Zeta.nn"

when I was using the "MambaBlock" in "Zeta.nn" on the GPU, there were the following error:
"RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!"
I am sure that the error is from the "MambaBlock".
I guess the tensor operation in the "ssm" module was not placed on CUDA, although I have already placed the entire designed neural network on CUDA.

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

The complete test code is as follows:
import torch.nn as nn
import torch
from zeta.nn import MambaBlock
device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')
x = torch.Tensor(1, 2048, 1).to(device)
print("x size: {}".format(x.size()))
model = MambaBlock(dim=1, expand=4, depth=1, d_state=8, d_conv=3, bias=True).to(device)
print(model)
out = model(x)
print("out size: {}".format(out.size()))


EVEREST-663 Check if everest installed before uninstalling

CHANGE DESCRIPTION
Problem:
EVEREST-663
Short explanation of the problem.
Related pull requests

[link]

Cause:
Short explanation of the root cause of the issue if applicable.
Solution:
Short explanation of the solution we are providing with this PR.
CHECKLIST
Jira

[x] Is the Jira ticket created and referenced properly?

Tests

[x] Is an Integration test/test case added for the new feature/change?
[ ] Are unit tests added where appropriate?

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (b6a237d) 5.36% compared to head (9ac651e) 5.36%.

Additional details and impacted files
@@          Coverage Diff          @@
##            main    #238   +/-   ##
=====================================
  Coverage   5.36%   5.36%
=====================================
  Files         13      13
  Lines       2889    2889
=====================================
  Hits         155     155
  Misses      2707    2707
  Partials      27      27

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Re-order columns on "Result Search" page

Is your feature request related to a problem? Please describe.
Improve overview of results
Describe the solution you'd like
Current width of the "Result search" table requires horizontal scrolling to see the numbers. Suggestion is to re-order columns:
Benchmark | Site | Site Flavour | 'Benchmark related parameters' | Data | Tags (?) | Uploader | Actions
Describe alternatives you've considered
Maybe the width of the table could be increased a bit.

Suggestion is to re-order columns:
Benchmark | Site | Site Flavour | 'Benchmark related parameters' | Data | Tags (?) | Uploader | Actions

What does 'Benchmark related parameters' entail? Putting all of the notable columns in there may be a bit much, and you can already reorder most of the columns manually.

Current width of the "Result search" table requires horizontal scrolling to see the numbers

The width is limited to 1140px in default bootstrap 4.5 containers, I can however make it always use 100% of available width just for that search page.

'Benchmark related parameters' are those with "!" in the JSON template, i.e. which are already added today in the table. My idea is just re-order columns.

Instead of reording the columns, I've opted to implement some 'optimization' in regards to space usage. The 'Uploader' and 'Data' essentially having been buttons were merged with Actions. Actions has been made narrower by replacing text with icons (+ tooltips). With this, even on a 720p screen (as long as it's maximized), you would be able to see all columns of your deephdc/deep-oc-benchmarks_cnn:synthetic benchmark. Let me know if this is an acceptable alternative.
I may also set it up to not display the benchmark column if a benchmark is selected (=> redundant), but I'll wait on your decision about how we should handle the benchmark same-docker-image-different-tags situation.

Has this been resolved, or is a change still necessary?


First two characters are swapped in 'podman exec' streams, but not 'podman run'

After entering a toolbox the first character isn't displayed and instead is inserted after the second character is input. This happens on BASH and ZSH and with a test user with a vanilla homedir.
Fedora Silverblue 31, toolbox 0.0.17
Example: after typing "exit" immediately following "toolbox enter"

@haircommander PTAL

oh, hooray I already fixed this in https://github.com/containers/libpod/pull/4818 :smile: can you try latest master @debarshiray ?

I think a better question now might be what did #4818 not fix - great work @haircommander

We should cut a 1.7.1 after Devconf.cz to get this out into the wild


Logging in JSON

Summary
Hi. Argo's machinery logs in go plain logs, e.g. something like this:

which pollutes stderr and doesn't allow much filtering. Is there a way how it could log in JSON or somehow control the logging? Additionally, if the logging was structured (that is in JSON), one can much easily search in it.
Motivation
Cluster monitoring often have something like "if count(error_log) > 0, raise alert". E.g. GCP logging enables ingesting JSON and recognizing severity based on the severity field and also search via structured log records. The current design doesn't allow it.

We've had internal discussions about this too. Tracking this in #2308

Great.
And I was looking for logs and JSON and didn't find the issue, sorry


Authorization crashes on macOS Mojave

Description
In the example project, log in crashes after dismissing the web view. There is an assertion in WebKit that checks if it's called from main thread, but it's called not from the main thread. I wasn't able to fix it easily, because of the semaphore.
(Really it stops at previous instruction (at 0x00007fff4a525175 int 3 with EXC_BREAKPOINT, this stacktrace is after clicking Continue).
* thread #2, queue = 'SwiftyVK.sessionQueue', stop reason = EXC_BAD_INSTRUCTION (code=EXC_I386_INVOP, subcode=0x0)
  * frame #0: 0x00007fff4a525176 WebKit`WebKit::TiledCoreAnimationDrawingAreaProxy::~TiledCoreAnimationDrawingAreaProxy() + 90
    frame #1: 0x00007fff94f8fac0 WebKit`vtable for WebKit::TiledCoreAnimationDrawingAreaProxy + 16
    frame #2: 0x00007fff4a3624a4 WebKit`WebKit::TiledCoreAnimationDrawingAreaProxy::~TiledCoreAnimationDrawingAreaProxy() + 14
    frame #3: 0x00007fff4a6083df WebKit`WebKit::WebPageProxy::resetState(WebKit::WebPageProxy::ResetStateReason) + 109
    frame #4: 0x00007fff4a35de2e WebKit`WebKit::WebPageProxy::close() + 380
    frame #5: 0x00007fff4a744531 WebKit`-[WKWebView dealloc] + 57
    frame #6: 0x00007fff678647c2 libobjc.A.dylib`(anonymous namespace)::AutoreleasePoolPage::pop(void*) + 726
    frame #7: 0x00000001012f57dc libdispatch.dylib`_dispatch_last_resort_autorelease_pool_pop + 27
    frame #8: 0x00000001012fe923 libdispatch.dylib`_dispatch_lane_invoke + 563
    frame #9: 0x0000000101309f6c libdispatch.dylib`_dispatch_workloop_worker_thread + 691
    frame #10: 0x0000000101370058 libsystem_pthread.dylib`_pthread_wqthread + 409
    frame #11: 0x000000010136fe51 libsystem_pthread.dylib`start_wqthread + 13

Environment

Key
Value

Platform
osx

Platform version
10.14

Xcode version
10.0

Swift version
4

SwiftyVK version
3.1.9

Integration Method
manually

Checklist
Check all points of list below and set [x] on each checked point:

[x] I have looked and not find decision at README.md
[x] I have looked and reproduce this behaviour in Example project
[x] I have not find duplicates of this issue in issues list
[x] I made an understandable short title and exhaustive description
[x] I attach stack traces or errors description
[x] I completely describe the environment
[x] I have full filled out this issue template

Ок, посмотрю что там в ближайшее время

@usr-sse2, I fixed it)

@west0r, Спасибо, теперь работает)


Fix: Gateway fails to save federation config if one already exists

Gateway save federation config would File::open an existing config in readonly mode, then fail to ovewrite the content.
This fix applies File::create which always guarantees a write of the latest configs we are persisting.
NOTE: This fix introduces a new bug, where we may inadvertently overwrite any config previously saved.

Codecov Report
Base: 66.60% // Head: 65.52% // Decreases project coverage by -1.07% :warning:

Coverage data is based on head (a889454) compared to base (bde7f24).
Patch coverage: 0.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1056      +/-   ##
==========================================
- Coverage   66.60%   65.52%   -1.08%
==========================================
  Files         116      116
  Lines       17760    18033     +273
==========================================
- Hits        11829    11817      -12
- Misses       5931     6216     +285

Impacted Files
Coverage Δ

gateway/ln-gateway/src/client.rs
23.71% <0.00%> (+0.47%)
:arrow_up:

fedimint-server/src/consensus/mod.rs
87.73% <0.00%> (-2.67%)
:arrow_down:

fedimint-api/src/module/audit.rs
97.56% <0.00%> (-2.44%)
:arrow_down:

fedimint-server/src/lib.rs
79.29% <0.00%> (-2.30%)
:arrow_down:

modules/fedimint-ln/src/lib.rs
81.96% <0.00%> (-2.20%)
:arrow_down:

fedimint-api/src/db/mod.rs
81.13% <0.00%> (-1.57%)
:arrow_down:

client/client-lib/src/mint/mod.rs
76.75% <0.00%> (-1.44%)
:arrow_down:

modules/fedimint-mint/src/lib.rs
77.98% <0.00%> (-1.23%)
:arrow_down:

client/client-lib/src/wallet/mod.rs
65.87% <0.00%> (-1.21%)
:arrow_down:

modules/fedimint-wallet/src/lib.rs
83.75% <0.00%> (-1.13%)
:arrow_down:

... and 11 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

I'm not sure if it's the right thing to introduce the new bug, which seems more severe.

I think we need a nuanced solution to the save config sequence, and introducing the overwrite bug might be reasonable. Adding details to #1057

Without a solution for #754 and a way to authenticate configs this just creates a potential security issue for little benefit (we don't support changing much of the config server-side anyway right now). It just feels like doing things the wrong way around. For now just panicking in the else branch seems sufficient if the cfg already exists.

Abandoned in favor of #1096


When I executed test.py, this error occurred. Can you help me with this?

When I executed test.py, this error occurred. Can you help me with this?

Traceback (most recent call last):   File "tools/test.py", line 117, in <module>     main()   File "tools/test.py", line 106, in main     coco_eval(result_file, eval_types, dataset.coco)   File "/home/jason/notebook/mmdetection/mmdet/core/evaluation/coco_utils.py", line 31, in coco_eval     cocoEval = COCOeval(coco, coco_dets, iou_type)   File "/home/jason/anaconda3/envs/pytorch10/lib/python3.7/site-packages/pycocotools-2.0.0-py3.7-linux-x86_64.egg/pycocotools/cocoeval.py", line 76, in __init__     self.params = Params(iouType=iouType) # parameters   File "/home/jason/anaconda3/envs/pytorch10/lib/python3.7/site-packages/pycocotools-2.0.0-py3.7-linux-x86_64.egg/pycocotools/cocoeval.py", line 531, in __init__     raise Exception('iouType not supported') Exception: iouType not supported

我也遇到了同样的问题，请问怎么解决的？


Add a simple log in page to frontend

The Sleeky front page would be perfect for team members being confused by the complex admin page. It'd be great if you could add a simple log in freautre to the frontend so we can limit access.
Great work, keep it up!

You can access the internal Yourls methods. Add the following snipet at the beginning of your sleeky-fontend/index.php.
<?php
// Add login page
require_once( dirname(__FILE__).'/includes/load-yourls.php' );
yourls_maybe_require_auth();
?>

Hope I could help somehow!

@fscholdei
Sorry to bother you.
Thank you for the method you provided. How do I need to modify the code to enable it to log out of the account? Place it on the right side of the management button. Just like the backend management interface.
Hello admin (logout)


fix(knex): order by with a formula field should not include as

When doing an order by with a formula field it is generating it with an as which causes an invalid SQL error

Codecov Report

Merging #2848 (b92e563) into master (deb6d3d) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master     #2848   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files          194       194
  Lines        11734     11734
  Branches      2701      2701
=========================================
  Hits         11734     11734

Impacted Files
Coverage Δ

packages/knex/src/query/QueryBuilderHelper.ts
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update deb6d3d...b92e563. Read the comment docs.

Thanks!


MAINT: monthly dockerfile updates

Description
Please include a summary of the change. For large or complex changes please include enough information to introduce your change and explain motivation for it.
Changes proposed in this pull request:

Within 3 hours of opening PR, 2 dockerfile changes already opened:
https://github.com/oneapi-src/oneDAL/pull/2749
https://github.com/oneapi-src/oneDAL/pull/2751


add pr test data

Docs Build status updates of commit b65f7e1:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details
Dependent Files

versioning-test-v3/legacy/includes/token.md
:white_check_mark:Succeeded
View (< test-client-2.0)

1 file(s) depend on current file: versioning-test-v3/legacy/index.md

versioning-test-v3/legacy/index.md
:white_check_mark:Succeeded
View (< test-client-2.0)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Can I swtich another local LLM to drive the  Omost conversation?

Or just use a specific LLM finetune for Omost?

I believe you can, but your results will probably not be good or accurate, since that 3 LLM is capable of understanding the current methodology. In the Omost repo, https://github.com/lllyasviel/Omost, it's explained like this:

I have tried several representations, including pixel index like {x=32, y=16, w=58, h=99}, or margin pixels like {left=32, right=15, top=27, bottom=33}, or percentage pixel index like {x=0.124, y=0.65, w=0.335, h=0.251}, or percentage margin like {left=0.251, right=0.154, top=0.254, bottom=0.441}. The result is that opensource LLMs are really not very good at learning these representations even for Llama3 (perhaps GPT4o can learn it). Sometimes it works sometimes it gives completely random numbers. Note that our problem is very different from MLLM. The vision-LLM usually have image embedding as inputs and in that case estimating numeric position is like a look-up table problem and can somewhat be learned, but our case is where the LLM need to generate every composition from scratch without help of any image embedding to look-up.


Merge Signed FXP value rollover fix into the Release/20.6 branch

[x] This contribution adheres to CONTRIBUTING.md.

What does this Pull Request accomplish?
This pull request contains the fix introduced by PR #130.
Why should this Pull Request be merged?
This fix is required by the FPGA Addon to prevent Signed FXP value rollover when exceeding minimum/maximum limits of the FXP Configuration.
What testing has been done?
Run the new automated tests locally and they all passed. Built the CD locally and they all passed.

The direction of the PR is incorrect, Closing this PR and opening a new one.


Create a table in the README with all the networks the lib has been tested on

Network update can break the library so we want to say on which version of the network we tested the library and it is compatible.

In order to be able to test the lib in the network, we should coordinate with them to have addresses that have specific rights for each actor. We won't be able to test miner actor if we don't have some address that represents a miner. Same for market, data cap and others


can't remove movie from elementum library

I'm working with elementum's great trakt sync.
I sync my trakt watchlist into my Kodi library.
when I finished watching a movie, the trakt entry for that movie is automatically removed from the watchlist, but the movie remains in my library.
I tried to delete the folder that contains this movie in .kodi/temp/elementum_library/Movies, and to use "Remove from library" in the movie's context menu and "manage...", but it keeps coming back (presumably from the backup elementum makes from the db).
what is the correct way to remove items from the elementum library?
thanks!

@shmizan duplicate of #509


MM-26436: Allows others' posts to be delete with just 'delete_others_…

…posts' permission.
Summary
Allows edit others posts to function independent of edit own posts.
Ticket Link
https://mattermost.atlassian.net/browse/MM-26436
Checklist

[ ] Added or updated unit tests (required for all new features)
[ ] Has UI changes
[ ] Includes text changes and localization file updates

Device Information
none.

Building app in separate branch.

Successfully building:
https://circleci.com/gh/mattermost/mattermost-mobile/9314
https://circleci.com/gh/mattermost/mattermost-mobile/9312

Artifact links:
https://9314-70265724-gh.circle-artifacts.com/0/~/mattermost-mobile/Mattermost_Beta.apk
https://9312-70265724-gh.circle-artifacts.com/0/~/mattermost-mobile/Mattermost_Beta.ipa

@srkgupta gentle reminder.


[Q] How do I visualize all the tables that I have logged in a single run?

I know it is possible to use compare between tables of a single run and view them together. However, it is only possible to view 2 versions of the table together. What if I want to view all the versions of a table logged to the same key and see how a column improves over time?
The Weave table also lets you only see a table in the summary of the run, which means you can only view the last version of a table.

Hey @ATheCoder - just to make sure I'm understanding correctly, are you looking to compare tables over times/epochs? And would you be doing this via the Weave SDK, the wandb UI, or a Weave board?

Correct, I would be doing this via the wandb UI.
On Tue, 26 Sept 2023 at 22:27, umakrishnaswamy @.***>
wrote:

Hey @ATheCoder https://github.com/ATheCoder - just to make sure I'm
understanding correctly, are you looking to compare tables over
times/epochs? And would you be doing this via the Weave SDK, the wandb UI,
or a Weave board?
—
Reply to this email directly, view it on GitHub
https://github.com/wandb/wandb/issues/6359#issuecomment-1736106595, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AGQC5YD7GYGDVVFON44OR5DX4MQP3ANCNFSM6AAAAAA5EDLCTQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hey @ATheCoder - If you go to your run workspace > Add panel > Weave, you can include the expression below to be able to view multiple versions of a table logged in a single run: runs.history.concat["my_table_name"] - please let me know if this helps!

Hi @ATheCoder, since we have not heard back from you we are going to close this request. Please let me know if the above helped or if you have other questions!


Multiple genre support

Codecov Report

Merging #22 into master will decrease coverage by 7.84%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #22      +/-   ##
==========================================
- Coverage   98.39%   90.55%   -7.85%
==========================================
  Files          22       22
  Lines         812      826      +14
==========================================
- Hits          799      748      -51
- Misses         13       78      +65

Flag
Coverage Δ

#integration
?

#unit
90.55% <100.00%> (+0.16%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.


Getting rid of odo create and instead use odo component create

I feel as though we should refactor the way that we are using commands as the scope of the project becomes much larger.
We should follow a odo <component> <action> for all commands. For example: odo create should just be odo component create.
It doesn't make sense to prioritize components over services / storage / etc and not follow the common conventions.
It does however make sense to continue to use the commands as aliases, for example, odo create will always relate to component, however, it won't show in our default --help menu / documentation.
At the moment our help menu looks like this:
Component Commands:
  component   Components of application.
  create      Create a new component
  delete      Delete an existing component
  describe    Describe the given component
  link        Link component to a service or component
  list        List all components in the current application
  log         Retrieve the log for the given component.
  push        Push source code to a component
  update      Update the source code path of a component
  watch       Watch for changes, update component on change

Other Commands:
  app         Perform application operations
  catalog     Catalog related operations
  project     Perform project operations
  service     Perform service catalog operations
  storage     Perform storage operations
  url         Expose component to the outside world

Utility Commands:
  help        Help about any command
  utils       Utilities for terminal commands and modifying Odo configurations
  version     Print the client version information

When in reality we can have this:
Commands:
  app         Perform application operations
  component   Perform component operations
  catalog     Catalog related operations
  project     Perform project operations
  service     Perform service catalog operations
  storage     Perform storage operations
  url         Expose component to the outside world

Utility Commands:
  help        Help about any command
  utils       Utilities for terminal commands and modifying Odo configurations
  version     Print the client version information

Reading the complete issue, where you're referring just to how the documentation shows, I'm ok with that.

@jorgemoralespou Yeah, I'm talking with regards to the documentation.
With the documentation, should we instead prioritize / change the documentation to show odo component create and still keep the alias?

I agree. If it was up to me, as stated in #779, I'd remove the aliases altogether ;)

-1 to remove the aliases.

Closing this as a duplicate of #779. This is just splitting the same discussion to two places. Lets continue this in #779


v2 support ?

Any plans for supporting DrupalCommerce v2 ?

Hi @mrbase
This is sadly not a module we have enough request about. Therefore we have no plans right now to support v2.


Auto Import Bug

there is not Add import time in list.

This issue has been fixed in version 2020.9.0, which we've just released. You can find the changelog here: https://github.com/microsoft/pylance-release/blob/master/CHANGELOG.md#202090-3-september-2020