Enum plus plus

This PR adds Sourcery/Stencil templates to give Swift enum more powers!
Now we have the protocol EnumClosures, that when implemented in an enum will create closures for each enum case.
Using the following enum as example:
enum ViewState<T> {
    case start(data: T)
    case loading
    case completed(count: Int, message: String)
}

you can implement EnumClosures, by doing extension ViewState: EnumClosures, and Sourcery will generate the following code:
extension ViewState {
    internal func onStart(_ fn: (T) -> Void) {
        guard case let .start(data) = self else { return }
        fn(data)
    }
    internal func onLoading(_ fn: () -> Void) {
        guard case .loading = self else { return }
        fn()
    }
    internal func onCompleted(_ fn: (Int, String) -> Void) {
        guard case let .completed(count, message) = self else { return }
        fn(count, message)
    }
}

There is also the EnumProperties that will generate accessors for each case. So using the same enum, ViewState, you can extend ViewState to use EnumProperties by doing extension ViewState: EnumProperties which will generate the following code:
extension ViewState {
    internal var isStart: Bool {
        guard case .start = self else { return false }
        return true
    }
    internal var isLoading: Bool {
        guard case .loading = self else { return false }
        return true
    }
    internal var isCompleted: Bool {
        guard case .completed = self else { return false }
        return true
    }

    internal var start: T? {
        guard case let .start(data) = self else { return nil }
        return (data)
    }
    internal var completed: (count: Int, message: String)? {
        guard case let .completed(count, message) = self else { return nil }
        return (count, message)
    }
}

And by doing that, we are now able to write such code:
func render(viewState: ViewState<User>) {
    viewState.onLoading {
        // show loading indicator
    }

    viewState.onStart { user in
        // show the user
    }

    viewState.onCompleted { (count, message) in
        // show the cout and message
    }

    // Or

    view.loading = viewState.isLoading
    view.user = viewState.start
    view.countAndMessage = viewState.completed
}

Codecov Report

Merging #199 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #199   +/-   ##
=======================================
  Coverage   34.54%   34.54%
=======================================
  Files         292      292
  Lines        7292     7292
=======================================
  Hits         2519     2519
  Misses       4773     4773

Impacted Files
Coverage Δ

...ackerCore/MovieDetails/MovieDetailsViewState.swift
40% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5ed3c6b...df7a046. Read the comment docs.


Need hipfft interfaces to properly use hipcomplex types in HIP

What is the expected behavior

hipComplex types be used to implement hipfft interfaces

What actually happens

https://github.com/ROCmSoftwarePlatform/rocFFT/blob/develop/library/include/rocfft/hipfft.h#L49

Incorrectly defined float[2] or double[2] without properly using data types defined in HIP.
Relevant commit in TensorFlow ROCm port:
https://github.com/ROCmSoftwarePlatform/tensorflow/commit/ed6bf17441a1cfd808cac127fff6da830f4e8ec8

I have merged tensorflow branch into develop, next official packages of rocFFT should include this issue, should this remain open, or can you close?

Thanks let me update TensorFlow port and make sure it builds and runs then close the ticket

@bragadeesh TensorFlow builds with develop branch fine now. As most of users of TensorFlow would use rocfft in binary form as one of the components in ROCm stack, let me leave the ticket open for now and close it when the next ROCm release is published.

@bragadeesh , is this issue resolved?

I am closing this old issue; @whchung can reopen if this still a concern


Is tf.one_hot() w/ GPU not working under windows10?

I'm trying to run tensorflow in Windows10 environment.
When I use tf.one_hot function with GPU then it occur error.
Below is test code, and it's working find in Ubuntu.
Test code
from sklearn.datasets.samples_generator import make_regression
import tensorflow as tf

X, y, coef = make_regression(n_samples=100, n_features=2, noise=0.1, coef=True)
# To make all X values positive integer
X = list(map(lambda xx: list(map(lambda x: abs(int(x*10)), xx)), X))

tf.reset_default_graph()
def build_model(x):
    xs = tf.split(x, [1,1], 1)
    h1s = []
    for i in range(2):
        with tf.variable_scope('h1_%d'%i):
            # Seems below line is the problem..
            xs_temp = tf.reshape(tf.one_hot(xs[i], depth=30, on_value=1.0, off_value=0.0), [-1, 30])
            weights = tf.get_variable('weight', [30, 2], initializer=tf.contrib.layers.xavier_initializer())
            biases = tf.get_variable('biases', [2], initializer=tf.constant_initializer(0.0))
            xs_temp = tf.nn.relu(tf.matmul(xs_temp, weights) + biases)
            h1s.append(xs_temp)
    h1 = tf.concat(h1s, 1)
    with tf.variable_scope('h2'):
        weights = tf.get_variable('weight', [4, 1], initializer=tf.contrib.layers.xavier_initializer())
        biases = tf.get_variable('biases', [1], initializer=tf.constant_initializer(0.0))
        y = tf.matmul(h1, weights) + biases
    return y

with tf.device('/gpu:0'):
    X_ph =  tf.placeholder(shape=[None,2],dtype=tf.int32)
    y_ph =  tf.placeholder(shape=None,dtype=tf.float32)
    output = build_model(X_ph)
loss = tf.losses.mean_squared_error(y_ph, output)
updateModel = tf.train.AdamOptimizer(1e-2).minimize(loss)

init = tf.global_variables_initializer()
config = tf.ConfigProto()
config.gpu_options.allow_growth = True
with tf.Session(config=config) as sess:
    sess.run(init)
    for _ in range(100):
        sess.run(updateModel, feed_dict={X_ph: X, y_ph: y})

Error
InvalidArgumentError (see above for traceback): Cannot assign a device for operation 'h1_1/one_hot': Could not satisfy explicit device specification '/device:GPU:0' because no supported kernel for GPU devices is available.
	 [[Node: h1_1/one_hot = OneHot[T=DT_FLOAT, TI=DT_INT32, axis=-1, _device="/device:GPU:0"](split:1, h1_1/one_hot/depth, h1_1/one_hot/on_value, h1_1/one_hot/off_value)]]

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10
TensorFlow installed from (source or binary): pip install tensorflow-gpu
TensorFlow version (use command below): 1.3.0
Python version:  3.6
Bazel version (if compiling from source):
CUDA/cuDNN version: 8.0/5.1
GPU model and memory: Titan XP (12GB)
Exact command to reproduce:

(1) Refer using_gpu link for NVIDIA devices.There is a option of allow_soft_placement which might work for you.
(2) For windows 10, there are a few gpu settings which works well along with GPU. You can check link here.

In case I set allow_soft_placement=True, or I didn't specifically set with device='/gpu:0' in graph, tf.one_hot is automatically allocated to /cpu:0. It's working but it's getting really slow because all the data are need to be transferred between cpu and gpu memory.

I have following questions,
Do you get any warning while putting allow_soft_placement=True ? Is it correct?
Also, What is the computation speed difference between Ubuntu and Windows OS for a same program?

It's not possible to use with tf.device('/gpu:0'): to wrap an entire model to have it execute purely on the GPU. TensorFlow actually schedules to the GPU automatically, when it makes sense to do so.
There are actually a significant number of ops that only have CPU kernels. The ops that have both CPU and GPU kernels are mostly the ones that would stand to gain from the number crunching GPUs provide.
If the cost of copying memory between CPU and GPU is an issue, you might be able to find help redesigning your model to work around that on Stack Overflow.

What I've issued is tf.one_hot is perfectly allocate to /GPU:0 on Linux, but it can not be allocated on WIndows environment. I think the GPU kernel for Windows is not developed or have some error. And it makes 4~5 times slower on Windows than I have run on Linux when I allocated CPU for tf.one_hot module.


cannot import name 'thread_pool' from 'src.utils.global_param'

when run
python main.py --llm_name gemma-2b-it

the ERROR occurs
ImportError: cannot import name 'thread_pool' from 'src.utils.global_param'

Thanks for the attention!
We have updated the version to fix this. If this error still happens, please let us know.

hi, there is a new ERROR for the latest code
cannot import name 'AgentProcessQueue' from 'src.agents.agent_process'

I also had the same issue. You can uncomment lines of  AgentProcessQueue: at src/agent_process.py


Add beagleboard ai, thunderx and stm32mp1 to the arm_cpu target.

This adds three new models to the arm_cpu target. Two 32 bit devices, the beagle board-X15 and the STM32MP1, and a 64 bit device the ThunderX server.
Signed-off-by: Tom Gall<EMAIL_ADDRESS>

LGTM

Thanks @tom-gall @leandron @junrushao1994


Use cirq.ResultDict in StimSampler when available

The cirq.Result constructor is deprecated as of https://github.com/quantumlib/Cirq/pull/4806. Instead, we should use a concrete type like cirq.ResultDict. This changes StimSampler to use cirq.ResultDict when available, to avoid deprecation warnings.
I'm also curious to know what is the support policy for stimcirq supporting different pyle versions. This workaround can be removed whenever support for cirq < 0.14 is dropped.

To be honest, stimcirq's support policy across version is "I try not to think about it too much". I make sure the latest versions of stim and stimcirq work together, and that stimcirq works with the latest stable version of cirq, and otherwise am just hoping for the best.
One of the reasons I refuse to pin the cirq version that stimcirq depends on is so that downstream users have an easier time forcing a pair that works should the worst occur.


As a CIF administrator, I want to track additional funding sources, so that I know where project's funding comes from

Description:
This feature is about managing multiple funding sources for a project.
Wireframe: https://www.figma.com/file/PzOY8RyQnVXnjZJdSv2AqQ/Wireframing_Figma?node-id=2898%3A2863
Acceptance Criteria:
Given I am a CIF administrator
When I create or edit a project
And I am on the "Budget, expenses and payments" form,
Then I can click an "Add Funding Source" button to add additional (non-gov) funding sources
Given I am a CIF administrator
When I add additional funding sources
Then for each funding source, I can enter the following data:

Additional Funding Source: freeform field
Additional Funding Amount: freeform field
Additional Funding Status: dropdown for selection (awaiting approval, approved, denied)

Given I am a CIF administrator
When I create or edit a project
And I am on the "Budget, expenses and payments" form,
Then I can remove additional (non-gov) funding sources
Development Checklist:

[ ] a cif.additional_funding_source table, with the following fields:

id: integer PKEY
project_id: integer FKEY to cif.project(id)
source: varchar(1000)
funding_amount: numeric
status: enum(awaiting approval, approved, denied)

[ ] Forms and mutations similar to contacts to add / remove from a revision
[ ] Meets the DOD

Definition of Ready (Note: If any of these points are not applicable, mark N/A)

[ ] User story is included
[ ] User role and type are identified
[ ] Acceptance criteria are included
[ ] Wireframes are included (if required)
[ ] Design / Solution is accepted by Product Owner
[ ] Dependencies are identified (technical, business, regulatory/policy)
[ ] Story has been estimated (under 13 pts)

·Definition of Done (Note: If any of these points are not applicable, mark N/A)

[ ] Acceptance criteria are tested by the CI pipeline
[ ] UI meets accessibility requirements
[ ] Configuration changes are documented, documentation and designs are updated
[ ] Passes code peer-review
[ ] Passes QA of Acceptance Criteria with verification in Dev and Test
[ ] Ticket is ready to be merged to main branch
[ ] Can be demoed in Sprint Review
[ ] Bugs or future work cards are identified and created
[ ] Reviewed and approved by Product Owner

Notes:

Hey team! Please add your planning poker estimate with ZenHub @BCerki @dleard @gurjmatharu @matthieu-foucault @mikevespi @Sepehr-Sobhani

@nanyangpro will add the 'remove' button on the wireframe

Thank you @Sepehr-Sobhani ! Tested in Dev by creating a new project and editing an existing project with funding sources. Meets acceptance criteria. Cheers!


[wrt] Remove the duplicate TCs from packertool

The test suite can run normally

Impacted TCs num(approved): New 0, Update 0, Delete 70

LGTM


Implement a type definition manager for TypeScript

Typings seems to be a promising alternative.
More info:

Typings vs TSD
TSD Future

I think it would be cool to make a list (or even an array if supported) of advantages and disadvantages for both. A sort of comparison to understand a little bit more.

Sure good idea. See 'More info' in the original post.

:+1: typings

Done in https://github.com/ghpabs/angular2-seed-project/commit/9214cf77391652c89ae98f39149f5b33ff32fc6b and polished up in https://github.com/ghpabs/angular2-seed-project/commit/7b001b2e75eddb365d0319ccfec9805d3bdca20f.


Replace Cassandra sink with Kafka sink

We publish a simple flat/primitive structure to Kafka so that [1] the event is easy to process by any downstream processing (e.g. Spark Structured Streaming or DB ingestion) and [2] we decouple the Spark Streaming data representation from the data storage representation in Kafka.

@c-w  A question related to this PR came up during todays standup, which can wait til tomorrow for an answer... What are the drawbacks with converting the fortisEvents to a DataFrame via toDF as opposed to funneling all pipeline events to Kafka? We'll probably need to add ~2 new VMs to our cluster for Kafka. I fully agree with the direction towards DataFrames / Datasets, but there seems to be other options available to us https://indatalabs.com/blog/data-engineering/convert-spark-rdd-to-dataframe-dataset.

@erikschlegel From my understanding, DataFrames and Structured Streaming are orthogonal concerns. The former is a way to represent data inside of Spark, the latter is a way to process data by event-time as opposed to batch-time; it's merely coincidental that they both expose a SQL API. There's a section in the Structured Streaming docs that talks a bit about the difference and about the currently available ways to create a structured stream (which for now is just Kafka or the file system).

@c-w I appreciate you putting this together, but I'm still unclear that we need the dev-ops overhead of Kafka introduced to the pipeline. We can transform the rdd collection of fortisEvents to DataFrames via val df = sqlContext.createDataFrame(fortisEvents. I understand that Kafka offers us the ability to replay historic streams, which isn't a requirement at the moment. Converting our events to DataFrames will ensure our event batch windows are reliably processed. My preference is to convert the rdds to DFs in ProjectFortis.scala... Open to hear more about what other benefits Kafka opens to us which warrants the cost and maintenance overhead?

@erikschlegel We talked about this in detail last week. We need structured streaming to deal with stragglers when aggregating the streams into time windows. Consider the following situation:
Let's assume our window size is Tw=5s

Let's assume we have event E1 generated at T0
Let's assume we have event E2 generated at T0+1s
Let's assume we have event E3 generated at T0+2s

We want E1, E2 and E3 to be aggregated in the same window since they all happened within a delta of Tw

Now let's add some processing downstream of the events.
E1 is simple so we process it in 1s, done at T0+1s
E2 is simple so we process it in 1s, done at T0+2s
E3 is complex so we process it in 4s, done at T0+6s

Now we run the aggregation windows and we only pick up E1 and E2 and drop E3 because it's a straggler.

Spark DataFrames won't help us with this issue (sample reference 1, sample reference 2). The only way to solve the straggler problem in traditional Spark is to make your batch sizes big enough that you hope you will capture all the variance in processing within it which is not a reliable approach and should not be used if we want even just semi-reliable aggregation results.
DataFrames and structured streaming are unrelated, really; they just have the same API: DataFrames are a way to give a SQL-like query interface for a set of Spark RDDs, Structured streaming on the other hand is a way to aggregate data and automatically re-run the aggregation in case of stragglers.

Agree with you on using Structured Streaming. We can use structured streaming through event hub(which is a managed Azure service) or just converting each rdd into a dataframe. My earlier point was to better understand the benefits of Kafka as opposed to the other two approaches mentioned ^^^.

I didn't know that EventHub offers Structured Streaming; thanks for bringing that to my attention. Reading their docs, it looks as though the functionality is pretty beta-quality though, so I'm not sure how comfortable I'd be building on it, especially given that their future improvements contain some pretty basic functionality:

Given that Structured Streaming itself is pretty new, I'd simply go for the path of least resistance and use the Spark recommended way to integrate with Structured Streaming which is Kafka.


Update File

@viniciusfdasilva  thnx for contributing, try this year, and make sure you follow me and star this repo for updates about special swags I will be giving.
Contribute in October for Hacktoberfest 2020


How to use the short PE reads in the -R parameter

Hi Malonge. When we used the short reads for the misassembly correction, the short reads usually have two files: *1.fq.gz and 2.fq.gz (PE sequencing), but the –R parameter only support one file in your manual (As of today, only one file is allowed, so please concatenate your data into one file if necessary). How to use the short PE reads in the -R parameter?

Hi there,
Paired-end info is not used to detect misassemblies - only coverage. So you can go ahead and just throw those reads into one large file. RagTag does allow one to specify a list of files that makes it a little more convenient.
There is a chance that I will revisit this in the future and try to use paired-end info to detect subassemblies.
Thanks


Preventing activity-stream.topstories.json from getting downloaded

Even with:
user_pref("browser.newtabpage.activity-stream.enabled", false);
user_pref("browser.library.activity-stream.enabled", false); // (FF57+)
Firefox 60.0b8 is downloading data to create activity-stream.topstories.json within the current profile.
UPDATE: Also activity-stream.tippytop.json
How do we make it stop?

The "refreshed new tab page" has a repo

https://github.com/mozilla/activity-stream/commit/c260e0a
https://github.com/mozilla/activity-stream/commit/0376728

Maybe blocking getpocket.com and getpocket.cdn.mozilla.net may help.
https://bugzilla.mozilla.org/show_bug.cgi?id=1410075 RESOLVED WONTFIX

From DXR, "testing" setup: "Use an empty list of sites to avoid fetching"
// Use an empty list of sites to avoid fetching
user_pref("browser.newtabpage.activity-stream.default.sites", "");
user_pref("browser.newtabpage.activity-stream.telemetry", false);
user_pref("browser.newtabpage.activity-stream.tippyTop.service.endpoint", "");
user_pref("browser.newtabpage.activity-stream.feeds.section.topstories", false);
user_pref("browser.newtabpage.activity-stream.feeds.snippets", false);

In 59->60 diffs, there are 4 browser.newtabpage* prefs in the user.js that are being deprecated/removed. The bugzillas are listed next to them thanks to earthlng, there are three of them. I haven't looked at this yet.
As for the activity stream page, the cog in the top right has options under it to control snippets, top stories, search element, etc. I disabled all that in my 60beta. I will check what prefs they map to in 60. And I'll check if any connection are made when disabled

@Thorin-Oakenpants You got me thinking... I never even see FF's newpage tab.  So I forced FF to use it, and then clicked on the cog, and turned everything off.  So far, no spurious files being added to the profile.
I had done that in the past, but FF must have turned everything back on when they came out with a new version of newtab.

Ch-ch-ch-ch-changes ... can't open 60 right now, and I think this new UI is 61 (https://pbs.twimg.com/media/DYzdC_XW4AAMzxV.png)
See the Homepage & New Windows > dropdown - Firefox Home (default)=activity stream. They've just simplified things with AS & homepage & new windows etc, hence why the master switch of browser.newtabpage.activity-stream.enabled is gone, as it probably now maps to 0103 (set home page) or something like that. Also, never understood why they had a separate new tab and home page setting - seems like its combined now
I would expect the right setting will stop background grabbing stuff, but it wouldn't surprise me if its happening (regression or by design) and it may be we have to add the snippets, top sites, highlights prefs to the user.js

In FF60.08b, there is no new preferences Home tab, that must be in coming in 61. Anyway, the cog wheel items in 60 are respective prefs are
Activity Stream cog wheel: New Tab Preferences

Search = browser.newtabpage.activity-stream.showSearch
Top Sites = browser.newtabpage.activity-stream.showTopSites
Highlights = browser.newtabpage.activity-stream.feeds.section.highlights
Snippets = browser.newtabpage.activity-stream.feeds.snippets

Now I was in a new profile with a couple of preset changes (I keep a copy for starting new types of tests), so all these were already disabled, and my start page etc was the activity page with nothing on it. I must have had some local data already present, because as soon as I toggled Top Sites on, I instantly had tiles. This may just be the Alexa top100 or so sites pre-listed with FF, I'm not sure. I think all these prefs do is to hide the relevant sections

1433133 FF60

comment 0 has some info

about:home can revert to the classic version by turning off browser.newtabpage.activity-stream.aboutHome.enabled and about:newtab can revert to Tiles by turning off browser.newtabpage.activity-stream.enabled.

So they want to remove the classic about:home and I guess about:newtab as well (I'll have to set up a 61Nightly and see what that new Home options tab offers). This kinda leaves 60 in the middle of changes.
Note: both these prefs were removed (in 1433324 below), but we never had browser.newtabpage.activity-stream.aboutHome.enabled in the user.js.

1433324 - removes the two prefs and assumes everyone wants AS
.. man, I've just about had it with all this crap, reading thru all this rubbish trying to keep up. NO means no. FFS :grumpyface:  How TF am I am suppose to work out how to make sure AS never loads and no external connections are ever made. FFFFFFFFFFk
How about we just edit the user.js to say, DELETE the AS xpi, and set your home page to about:blank (unless they set about:blank to use activity stream as well)

deprecated/removed in 60
pref("browser.newtabpage.activity-stream.enabled", true);

https://bugzilla.mozilla.org/show_bug.cgi?id=1433324

pref("browser.newtabpage.directory.source", "https://tiles.services.mozilla.com/...");

https://bugzilla.mozilla.org/show_bug.cgi?id=1370930

pref("browser.newtabpage.enhanced", true);
pref("browser.newtabpage.introShown", false);

https://bugzilla.mozilla.org/show_bug.cgi?id=1433133

All these tickets and others I dig into linked in the comments etc, reviewing them, all I see is removal of code, and I cannot work out what replaces them. Nothing I guess since they want to force AS on everyone. Other changes don't land until 61. Wot a mess.

Nightly 61.0a1
about:preferences#home UI shows :
Homepage and new windows : blank page, Firefox Home (default), custom URLs
New tabs : blank page, Firefox Home (default)
I set blank page for both.
Firefox Home Content : Choose what content you want on your Firefox Home screen (web search, top sites, recommended by Pocket, highlights, snippets could be un-ticked)

Nah, its deeper than that. Not looked at 61 like you have, but I need to deal with 60. Some of the AS page cog icon options are misleading - they only hide the section, not disable it. Also, I can't seem to trigger getting any highlights or topstories or snippets in my nilla 60 - I guess it's on a timer or triggered by x views and loads of traffic. I ain't got time for that
In FF60:

browser.newtabpage.activity-stream.default.sites is why I had some instant top sites = harmless
browser.newtabpage.activity-stream.feeds.section.topstories.options

set to blank, maybe this stops pocket (it should, the whole thing is pocket)

browser.newtabpage.activity-stream.telemetry.ping.endpoint -> points to "https://tiles.services.mozilla.com/v4/links/activity-stream"

blank it to stop ??

browser.newtabpage.activity-stream.feeds.topsites

note cog wheel option prefs is *showTopSites ..  They not listed as new in 59->60 diffs. I think the above should kill it all, probably one or two are redundant, but f**d if I know because its a labyrinth. I feel like Andy in The Shawshank Redemption crawling thru 500 yard of sewer pipe (in reality, anyone doing that would die from the fumes).

Homepage and new windows : blank page, Firefox Home (default), custom URLs
New tabs : blank page, Firefox Home (default)

Wait a second... are you telling me that a new tab can't use a custom URL (you know, like a speed dial extension) .. I F hope not - surely an extension can still hook in (you know, "an Extension has set your homepage" bit).

are you telling me that a new tab can't use a custom URL

Yes.
At least on the UI, I don't search about:config to find an option to do that.

If I get time I'll grab a nightly portable and install Group Speed Dial. I'm betting extensions can still hook into new tab

^^ when you set a custom url (in my case I pasted in the moz-extension... address, then the New Tab section changes - see pic

I'm now getting activity-stream.tippytop.json in the profile on 60.0b8.  WTF.

user_pref("browser.newtabpage.activity-stream.tippyTop.service.endpoint", ""); // favicons in AS

@Thorin-Oakenpants asks... browser.newtabpage.activity-stream.telemetry.ping.endpoint points to "https://tiles.services.mozilla.com/v4/links/activity-stream"

blank it to stop?

Not enough, according to: https://github.com/mozilla/onyx/blob/master/onyx/default_settings.py#L18
Look, there are 4 CDN links -> https://tiles.cdn.mozilla.net/

// These fields are sent from the client
"client_id": "374dc4d8-0cb2-4ac5-a3cf-c5a9bc3c602e",
"session_id": "{12dasd-213asda-213dkakj}",
"profile_creation_date": 14786,

// These fields are generated on the server
"ip": "<IP_ADDRESS>",
"receive_at":<PHONE_NUMBER>000

Source: https://github.com/mozilla/activity-stream/blob/b69291f6f37d1625134247c537d8796aae2c0695/docs/v2-system-addon/data_dictionary.md
The server is onyx

@Thorin-Oakenpants asks: browser.newtabpage.activity-stream.telemetry.ping.endpoint points to "https://tiles.services.mozilla.com/v4/links/activity-stream"

blank it to stop?

Not enough, according to: https://github.com/mozilla/onyx/blob/master/onyx/default_settings.py#L18
Look, there are 4 CDN links -> https://tiles.cdn.mozilla.net/
activity-stream is full-off telemetry:

// These fields are sent from the client
"client_id": "374dc4d8-0cb2-4ac5-a3cf-c5a9bc3c602e",
"session_id": "{12dasd-213asda-213dkakj}",
"profile_creation_date": 14786,

// These fields are generated on the server
"ip": "<IP_ADDRESS>",
"receive_at":<PHONE_NUMBER>000

Source: https://github.com/mozilla/activity-stream/blob/b69291f6f37d1625134247c537d8796aae2c0695/docs/v2-system-addon/data_dictionary.md
The server is onyx

@Gitoffthelawn You may know this already and sorry if you mentioned this and I missed it but you can just delete the activity-stream system extension from your application folder. I do this after every update or fresh install along with the other system extnesions. My about:support shows nothing under Firefox Features.

@grauenwolfe No harm in mentioning it! :)
I think it's worthy of a new issue... #397

I'm using this issue as a ticket to revamp item 5014. I'm not sure if I want to include let alone maintain all those prefs, and I certainly can't be bothered with checking that telemetry in AS respects FF's send data preference. Not can I be certain that "pings" respect telemetry because see pingsender.exe which doesn't. And I can't be certain that stuff isn't sent if we block pref urls, because stuff may be hardcoded (I'm done wasting my time in this maze).
It will probably end up like follow on search 5013 - instructions to set Homepage/newwindows and newtab to about:blank or use an extension, and delete the xpi.

@earthlng So what's the verdict? Add all these prefs in (maybe dig into the code a little to check what isn't strictly needed) or just tell people to delete the xpi and change their homepage etc?
Because the xpi is always added when the app updates, users could inadvertently run FF with this present (I'm not even sure if anything happens (data collection) when AS isn't used to load newtab or homepage). So I'm leaning towards adding all the prefs, but would need some help deciphering which ones are necessary.

just tell people to delete the xpi and change their homepage etc

:+1:
The telemetry uses ping-centre and should be covered by 0506 and 0333.
If you wanna add the prefs I'd just disable everything:
user_pref("browser.newtabpage.activity-stream.disableSnippets", true);
user_pref("browser.newtabpage.activity-stream.feeds.aboutpreferences", false);
user_pref("browser.newtabpage.activity-stream.feeds.favicon", false);
user_pref("browser.newtabpage.activity-stream.feeds.migration", false);
user_pref("browser.newtabpage.activity-stream.feeds.newtabinit", false);
user_pref("browser.newtabpage.activity-stream.feeds.places", false);
user_pref("browser.newtabpage.activity-stream.feeds.prefs", false);
user_pref("browser.newtabpage.activity-stream.feeds.section.highlights", false);
user_pref("browser.newtabpage.activity-stream.feeds.section.topstories", false);
user_pref("browser.newtabpage.activity-stream.feeds.section.topstories.options", "");
user_pref("browser.newtabpage.activity-stream.feeds.sections", false);
user_pref("browser.newtabpage.activity-stream.feeds.snippets", false);
user_pref("browser.newtabpage.activity-stream.feeds.systemtick", false);
user_pref("browser.newtabpage.activity-stream.feeds.telemetry", false);
user_pref("browser.newtabpage.activity-stream.feeds.topsites", false);
user_pref("browser.newtabpage.activity-stream.migrationExpired", true);
user_pref("browser.newtabpage.activity-stream.prerender", false);
user_pref("browser.newtabpage.activity-stream.section.highlights.includePocket", false);
user_pref("browser.newtabpage.activity-stream.showSearch", false);
user_pref("browser.newtabpage.activity-stream.showSponsored", false);
user_pref("browser.newtabpage.activity-stream.showTopSites", false);
user_pref("browser.newtabpage.activity-stream.telemetry", false);
user_pref("browser.newtabpage.activity-stream.telemetry.ping.endpoint", "");
user_pref("browser.newtabpage.activity-stream.telemetry.ut.events", false);
user_pref("browser.newtabpage.activity-stream.tippyTop.service.endpoint", "");

browser.newtabpage.activity-stream.feeds.aboutpreferences is new in FF61. FF61 also adds:
pref("browser.newtabpage.activity-stream.feeds.messagecenterfeed", true);
pref("browser.newtabpage.activity-stream.feeds.theme", true);
pref("browser.newtabpage.activity-stream.messageCenterExperimentEnabled", false);

Sheeshus H Christ .. that's a lot of prefs. OK, I think we'll stick with the KISS principle :kiss:

Which is what in this case?  Deleting the XPI is nice and clean, except for the fact that it gets reinstalled at (almost) every release (which is weekly is you are on beta and daily if you are on nightly).

KISS = least lines possible, plus it removes the overhead of dealing with all the gazillion changes they keep making. Sucks to be on nightly then - but I can add a line about browser.newtabpage.activity-stream.*

The telemetry uses ping-centre and should be covered by 0506 and 0333

IDK about that. I don't have the full STR, but OP had issues with data still being collected. IDK if it was sent, but it was being collected!

^^ comments on my patch? I feel that for me, I'll be fine .. but others may not be, because local data is still compiled (not 100% sure on that) if the xpi is present

How hard would it be to get essentially a "blank" add-on submitted to AMO with the same ID as activity stream?
Available locations, starting from the highest priority include:

    1. temporary install (about:debugging)
    2. normal user install into profile (about:addons or AMO/TestPilot/etc.)
    3. system add-on updates
    4. built-in system add-ons

This makes it possible for a developer or user to override a system add-on by installing an add-on with the same ID from AMO or TestPilot or as a temporary add-on.

https://firefox-source-docs.mozilla.org/toolkit/mozapps/extensions/addon-manager/SystemAddons.html
Was just trying to think of a way to override the .xpi file on a per-profile basis and not have to worry about the file being re-installed upon updates.

with the same ID

I would have assumed it would be impossible (in stable, signed extensions) because surely whatever is used as the ID is unique? Over my head. Not an extension dev. Otherwise, surely we would have seen malicious extensions using this by now - or did I misunderstand something?

I would have assumed the same (I'm also not very familiar with webextension development), but the documentation seems to imply it's possible, specifically:

This makes it possible for a ... user to override a system add-on by installing an add-on with the same ID from AMO

Maybe @earthlng would have a little more insight here?

Even if it were possible, and it would have to be signed, I think Mozilla would shut it down - the extension and maybe/probably the method, IDK. They refused to show system addons in about:addons and allow any way to disable them - wontfix, wontfix, wontfix

A blank xpi would be an easy and elegant set-and-forget solution for everyone but, personally, this is the kind of task I use scripts for.
A likely working alternative would be to make a blank xpi and tamper with access rights to prevent it from being overwritten by Firefox, but I don't know if the latter would be OK with that.

I was just about to look into the blank addon a bit more. Simply using the following for manifest.json works to override the<EMAIL_ADDRESS>when loaded as a temporary add-on:
{

  "description": "A blank extension used to override the Activity Stream system add-on. See https://firefox-source-docs.mozilla.org/toolkit/mozapps/extensions/addon-manager/SystemAddons.html",
  "manifest_version": 2,
  "name": "Activity Stream Override",
  "version": "1.0",

  "applications": {
  "gecko": {
    "id"<EMAIL_ADDRESS>  }
}

}

I can try submitting it to AMO and see if it's rejected or not.
A script would certainly be an effective method, but personally I would like a per-profile solution (I need access to the activity stream for another repo I maintain).

No luck submitting to AMO. I get the following from the validation report:
You cannot submit an add-on with a guid ending<EMAIL_ADDRESS>or<EMAIL_ADDRESS>or<EMAIL_ADDRESS>I can try using the signing API, but would be surprised if it's the same issue..

^^ yeah, but can you "hijack" a non mozilla extension this way?

I just tried to upload a blank one using the id for uBO and it failed with the following error:
Your add-on failed validation with 1 error.

    * Duplicate add-on ID found.

So it doesn't look like that would be possible.

For Windows, I have written a script that runs Firefox using Shell.Run.
I'm thinking that before the Shell.Run command, to delete any unwanted Firefox Feature .xpi files.
The challenge to doing this is that the script must have admin privileges in order to delete those .xpi files.
But it seems like a real bad idea to run Firefox from an admin elevated script.
Is it?  And if so, is there a way to accomplish this goal programmatically (that is, to delete the unwanted .xpi's using admin privileges, then run Firefox without any privilege escalation)?

Is it? And if so, is there a way to accomplish this goal programmatically (that is, to delete the unwanted .xpi's using admin privileges, then run Firefox without any privilege escalation)?

Nowadays Firefox runs sandboxed and there are now plenty of limitations on add-ons (since webextensions came to be), so I think it should be safe enough to run elevated. Still, you know how this has always been. You can't do much against zero-day attacks before they are discovered, and running Firefox with low privileges is one of the few things you can do.
As for your second question, I searched a bit and, apparently, it can be done using runas.exe, by passing trustlevel:0x20000 to it. Still haven't tried it out.

^^ https://github.com/ghacksuserjs/ghacks-user.js/blob/master/prefsCleaner.bat ... lines 53+

@Gitoffthelawn You mean to see if the script is working?
You can see it in the processes tab in task manager. Under Virtualization, it should say Not Allowed if the process running with admin privileges, otherwise it means it's not. You may need to make that column visible first from the menu (View > Select Columns).
@Thorin-Oakenpants the prefsCleaner doesn't care about admin privs, though. I'm sure there must be ways to check for that in VBS and PowerShell scripts, but I don't know if that's what @Gitoffthelawn wants anyway.

@claustromaniac I just wanted to be able to know a way to determine whether or not FF is running with admin privs.  Your tip regarding task manager will likely do the trick.  Thanks. :+1:

BTW, the column is entitled UAC Virtualization in Win7.

True. Sorry about that.
You know, I'm a bit curious about what you said before that the script does more than just delete those xpi files. Is it related or just personal-preference stuff? If there are other good reasons for using this sort of launcher script, maybe others can benefit from something like it too.
BTW, I was now thinking that for people that want to remove those files on a per-profile basis, like @overdodactyl, a script like this could simply rename/move the files instead of deleting them. I know it's far from ideal but it might be worth it in the long run. I know it wouldn't take too long to write a script like that.

for people that want to remove those files on a per-profile basis, like @overdodactyl, a script like this could simply rename/move the files instead of deleting them

I just gave that a try and interestingly get the error, "This addon could not be installed because it has not been verified"

It is kind of ironic their own extension isn't signed haha.
No luck there either unfortunately...no error message but it just doesn't go into effect.

^^ just tried that in my nightly and apparently activity-stream is not only unsigned but also a "legacy extension" - LO-fucking-L, mozilla and their fucking double-standards!

but it has to work somehow - how else would updates to system addons be able to work? maybe it needs to go into a special profile subfolder? has anyone ever received an update for one of the system addons and would know where these files are placed?

one workaround is to set extensions.legacy.enabled to true and xpinstall.signatures.required to false but that's only allowed in ESR and Nightly.

Ya I wish you were allowed to change that setting in stable as well.

Looking at the system addons, I'm curious how many of those are truly necessary:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>

I'm not seeing any references to activity-stream within a specific profile

I guess yet another workaround would be to simply use a different install of FF - one were the xpi file is deleted, one where it's not.

^^ that wouldn't work for people who update from within the app. And even if an install like that was around, its more work than it is to just delete the xpi files manually
The solution appears to be, in order to be 100% proof, to add all the prefs to the user.js, all 95 of them

https://firefox-source-docs.mozilla.org/toolkit/mozapps/extensions/addon-manager/SystemAddons.html

System add-on updates
These are installed into the users profile under the features directory.

And even if an install like that was around, its more work than it is to just delete the xpi files manually

True, but I was trying to address the issue of wanting to be able to access activity stream in one profile, while simultaneously having it removed from another without user.js.
I agree though, the best solution unfortunately seems to be to add those prefs.

These are installed into the users profile under the features directory.

The system addons (for me at least) are located in the features directory of my Firefox app (/Applications/Firefox.app/Contents/Resources/browser/features), but the features directory of an individual profile is empty

This local data collection - I wonder if AS runs in PB mode - if it does and collects things like most visited sites, that could be problematic. Wonder if @fmarier knows

ok I figured it out, the trick is to customize the pref extensions.systemAddonSet and the xpi needs to go in profile/features/{UUID}/ where UUID is a valid, well, UUID ;)
for example this works:
set extensions.systemAddonSet to {"schema":1,"directory":"{9c223810-fd9c-4c4d-809b-838623587fe7}","addons":{"activity-stream@mozilla.org":{"version":"2<IP_ADDRESS>1-d6edded2"}}}
To get the version of your activity stream xpi place it in your extensions folder and check about:support.
if necessary update the version in the extensions.systemAddonSet pref. Then move the xpi to profile/features/{9c223810-fd9c-4c4d-809b-838623587fe7}

Thanks @earthlng!! That seemed to do the trick :)

@Thorin-Oakenpants
https://sql.telemetry.mozilla.org/dashboard/activity-stream-metrics-summary - requires login

@Atavic - no, telemetry for Firefox users (nightly) web traffic of HTTP vs HTTPS - https://telemetry.mozilla.org/

So where are we with this?
Current
/* 0514: disable Activity Stream (FF54+)
 * Activity Stream replaces "New Tab" with one based on metadata and browsing behavior,
 * and includes telemetry as well as web content such as snippets and "spotlight"
 * [1] link etc

I created a patch (branch only, now deleted) with changes a week ago and no one said anything - its linked right there from 7 days ago
/* 0514: disable Activity Stream (FF54+)
 * Activity Stream is the default homepage/newtab, based on metadata and browsing behavior,
 * and includes telemetry and web content such as snippets, top stories (pocket), top sites, etc.
 *  - ONE: make sure to set your "home" and "newtab" to about:blank (or use an extension to control them)
 *  - TWO: DELETE the XPI file in your System Add-ons directory (note this get reinstalled on app updates)
 * And/or you can try to control the ever-growing, ever-changing "browser.newtabpage.activity-stream.*" prefs
 * [1] link etc

Or we could change the info bit to something like I have above AND add all 28 AS prefs, inactive maybe?. The only reason I would do this is because not all users will remember to remove the xpi each update
Where's the feedback on this, guys, gals?

I created a patch (branch only, now deleted) with changes a week ago

I didn't realize it was in a different branch, I thought you already committed it to the master.
As long as AS remains a system addon, the short one without the new prefs is fine IMO.


support bundle files without "index" in the name

We have a project where we have more entry-points in addition to the index.js, but these other entry-point files don't have index in their name.  (If you're curious about the  use-case for this, it's because we are using react-native-threads.
This PR is a different strategy for finding the dev server origin without looking specifically for index.  I'm very open to feedback on this approach or if anyone has a better idea for going about it.

With this approach, DEV_SERVER_ORIGIN is missing a protocol.

Oh you're right this is incomplete, I totally left out the protocol!
I was running into red screen errors, failing on this line of the polyfillEnvironment file, even though I hadn't turned on HMR. If there's a way to somehow opt out of this file getting run when I don't need HMR that would be a fine workaround for our project.

@Traviskn don't forget to rebase before you start working on that, we recently added a fix to this part of the codebase

You can move
https://github.com/joltup/haul/blob/2b7eb739cbc7d39efdc12a263a100413d350f5e4/src/utils/polyfillEnvironment.js#L39-L52
into src/hot/client/index.js but then it might break HMR on physical iOS devises.

Yes I'll rebase on master

While rebasing I noticed that the latest changes to the polyfillEnvironment.js actually do stop errors from being thrown, so my change isn't strictly necessary unless someone needs HMR in a bundle without index in the name.


Broken with amperstand symbol (&)

If i use amperstand symobol (&) in link, the web server recieves \xA7 instead of &.
Can you help me to fix this?

This is because Skript is encoding & into chat colors. You can work around this using a function to convert the URL back
function url(s: string) :: string:
  replace all "§" in {_s} with "&"
  return {_s}

THANKS! THANKS! THANKS! THANK YOU SO MUCH! You now got another star :)

And can you please add this in the main page with examples so other people won't have this bug?


Installation error: VirtualBox 5.1.14 / Vagrant 1.8.6 / Windows 10 x64

==> master: Downloading and installing linux version of 'kubectl' v1.5.2 into /opt/bin. This may take a couple minutes, depending on your internet speed..
==> master: Configuring environment..
==> master: Remote command execution finished.
==> master: Executing remote command "/opt/bin/kubectl config set-cluster default-cluster --server=https://<IP_ADDRESS> --certificate-authority=artifacts/tls/ca.pem"...
==> master:
==> master: Cluster "default-cluster" set.
==> master: Remote command execution finished.
==> master: Executing remote command "/opt/bin/kubectl config set-credentials default-admin --certificate-authority=artifacts/tls/ca.pem --client-key=artifacts/tls/admin-key.pem --client-certificate=artifacts/tls/admin.pem"...
==> master:
==> master: User "default-admin" set.
==> master: Remote command execution finished.
==> master: Executing remote command "/opt/bin/kubectl config set-context local --cluster=default-cluster --user=default-admin"...
==> master:
==> master: Context "local" set.
==> master: Remote command execution finished.
==> master: Executing remote command "/opt/bin/kubectl config use-context local"...
==> master:
==> master: Switched to context "local".
==> master: Remote command execution finished.
==> master: Configuring Kubernetes DNS...
==> master: Executing remote command "/opt/bin/kubectl create -f /home/core/dns-controller.yaml"...
==> master:
==> master: Error in configuration:
==> master: * unable to read client-cert /home/core/artifacts/tls/admin.pem for default-admin due to open /home/core/artifacts/tls/admin.pem: no such file or directory
==> master: * unable to read client-key /home/core/artifacts/tls/admin-key.pem for default-admin due to open /home/core/artifacts/tls/admin-key.pem: no such file or directory
==> master: * unable to read certificate-authority /home/core/artifacts/tls/ca.pem for default-cluster due to open /home/core/artifacts/tls/ca.pem: no such file or directory
==> master: Remote command execution finished.
The remote command "/opt/bin/kubectl create -f /home/core/dns-controller.yaml" returned a failed exit
code or an exception. The error output is shown below:

Error in configuration:
* unable to read client-cert /home/core/artifacts/tls/admin.pem for default-admin due to open /home/core/artifacts/tls/admin.pem: no such file or directory
* unable to read client-key /home/core/artifacts/tls/admin-key.pem for default-admin due to open /home/core/artifacts/tls/admin-key.pem: no such file or directory
* unable to read certificate-authority /home/core/artifacts/tls/ca.pem for default-cluster due to open /home/core/artifacts/tls/ca.pem: no such file or directory

I can confirm this issue when trying to build a cluster on Windows 10 (Using default config) I ran into the exact same issue: VirtualBox 5.1.14 / Vagrant 1.9.1 / Windows 10 x64 1607.
I could solve this issue by chaning the "artifacts" path in the "run_remote" commands on lines 296 to 302 and line 383, from a relative one "artifacts/tls" to "/vagrant/artifacts/tls..." . You can replicate this by executing a search/replace: from: artifacts/tls to: /vagrant/artifacts/tls in the vagrantfile.
I didn't check when or why this changed and I'm not sure if all artifacts should actually be copied to the home folder of the core user.  You could sync it i guess using the synced_folders.yaml. Pires, do you know the reason for this issue?

I can reproduce this issue as well in my Windows environment (Windows 10 Pro x64/VirtualBox 5.1.14/Vagrant 1.9.1).
I managed to fix this by symlinking /vagrant/artifacts to /home/core/artifacts directory. See this: https://github.com/najibninaba/kubernetes-vagrant-coreos-cluster/commit/b53712c07439be067609873f81ae20a8912fb757
/cc @pires, any concerns with this approach? So far, my Kubernetes tests are working fine. Let me know if you want me to send a PR on this?


Loosen devise dependency to ~> 4.1

We should be using SemVer here. devise 4.2 is out now and is required for rails 5.

Seems reasonable.  :+1:

:+1:, thanks @jhawthorn.


Usage with electron-builder, after build not include librsvg-2.2.dylib

Hi, as I see you have electron support for node-rsvg. I have issue with release my app with svg->png feature. Issue described here. When I switch 2gis/node-rsvg to f3lang/node-rsvg-prebuilt I get the same issue.  How I can implement f3lang/node-rsvg-prebuilt with electron and release it into dmg. Thanks.

Hi, i looked on the issue and saw, that you used electron 1.6
Right now, the project only supports up to electron 1.5 on darwin systems. I will update the prebuilt repositories to 1.6 on monday (I don't have access to a mac before).
Maybe then i can reproduce this issue on my system and see what is going on.
Do you have some sample code for me, where i can reproduce it?
One idea i have right now is the librsvg native libraries. Did you install them with homebrew under the user youre using to launch your project?

Hi, here is simpe example with f3lang/node-rsvg-prebuilt.

One idea i have right now is the librsvg native libraries. Did you install them with homebrew under the user youre using to launch your project?

yes
I create little sreencast what explain whats happend.
Steps in screencast:

I run released(dmg) example project and it work fine.
I remove librsvg from system.
Run released app again and get fault with it. (not convert file)

I right think what is electron app should work without installed system(librsv)?

Ahh.. now it seems like we are one step closer. Under darwin and linux systems this project only delivers the bindings to librsvg and relies on the preinstalled binaries (see the readme). Only for windows i did include the native libraries since it is an insane task to get librsvg and gtk running under windows. I will try to include the binaries tomorrow in the prebuilt packages, so it will work without installing the native dependencies on the system.

@f3lang sounds good, thank you.

@f3lang Hi, any updates?

I close the issue. Workaround is add libs into extra resources. Instructions here.


Change package name to apis-core-rdf

Given that #203 does not to be resolved any time soon, I propose to at least rename the package to apis-core-rdf instead of apis-core. This way we can use pypi without hijacking the apis-core pypi package and we can start publishing packages again.
Projects would then have to change the dependency definition from apis-core to apis-core-rdf

discussed in jfx and approved to change


Download Kubernetes binaries via synced folders - alternative for wget

No changes to cloud-configs?

Actually there are. Sorry, I had overlooked the possibility of only some of the files being copied over via synced folders. Pushed changes to cloud configs as well.

I'm testing but doesn't seem to work. I run vagrant up and binaries are still downloaded for every node.

@ravihansa3000 any comments?

Agreed. But handling cloud-config changes is going to be bit tricky, hence explicit sync folder approach. I'll see whether it can be improved without too much noise.

@pires care to share your thoughts?

@ravihansa3000 why not make it available by default?

source: /opt/kubernetes/v1.2.4/bin

I'd just change this to something like ./binaries, if relative paths are supported.

@pires Made some changes to make it available by default. Relative paths can be used with File.expand_path. Is this what you are looking for?
One problem is passing mount-options and nfs properties [1]. Parameterizing them would add unnecessary noise. What do you think?
[1] https://github.com/pires/kubernetes-vagrant-coreos-cluster/pull/198/files#diff-23b6f443c01ea2efcb4f36eedfea9089R538

Let me think about this in the next couple days.

I am traveling abroad but this is not forgotten. If I don't get back to you in a couple weeks, ping me.

So @ravihansa3000 a few thoughts:

After https://github.com/pires/kubernetes-vagrant-coreos-cluster/pull/194, synced folders are disabled by default. I am open to revert that behavior if it means faster deployments.
If synced folders are enabled, the current directory is already available to the VMs thus there's no need to add more stuff.

I'm going to try and make this happen. Will let you know how it goes.

I just realized your PR depends on manual downloading of the dependencies prior to vagrant up. While this works, I'm looking for a seamless way to do so.
Currently, I am downloading the binaries to the host then push to VMs - this has the advantage that synced folders do not need to be re-enabled by default, however can't run Linux binaries on Mac to verify binaries version.

OK, got the above to work but:

Before checking if files exist on the host, read a file with the latest version downloaded, e.g. VERSION. If file doesn't exist or version read doesn't match the desired version, then download.
Using file provisioner to copy binaries from host to VM is extremely slow (~1.5MB/sec here) so NFS would be the only solution and thus would need to revert #194. @chamilad any comments?

FIVE minutes to copy just the master node files!!!
==> master: 18:51:57: Copying ./binaries/kube-apiserver to /opt/bin/kube-apiserver..
==> master: 18:52:58: Copied /tmp/kube-apiserver to /opt/bin/kube-apiserver
==> master: 18:52:59: Copying ./binaries/kube-controller-manager to /opt/bin/kube-controller-manager..
==> master: 18:54:07: Copied /tmp/kube-controller-manager to /opt/bin/kube-controller-manager
==> master: 18:54:08: Copying ./binaries/kube-scheduler to /opt/bin/kube-scheduler..
==> master: 18:55:10: Copied /tmp/kube-scheduler to /opt/bin/kube-scheduler

It seems there are no other options and since this repo only supports MacOS X and Linux, I'm going to re-enable NFS and follow that path.

@pires This is all good, but will it work on a Windows machine? Not that it concerns me but I see some commits made to the repo just to make things work on a Windows env.

@ravihansa3000 while there's Windows support I can't keep with it, since I am not a Windows user. I know NFS should be supported, though.


App does not work after clean (React.children - related)

Just started a new project and saw this after npm run clean:

The cause is three occurrences of React.children instead of React.Children introduced here:
https://github.com/mxstbr/react-boilerplate/commit/ac1f6346535534e7061a8ba9b15a0f246a020a77
Replacing these strings manually brings the app back to work.

Oh no, would you mind submitting a PR fixing this?

Not earlier that tonight :–( This might be worth doing by someone else since it's rather urgent.

Thanks, I went ahead and did it in #818. Thanks a lot for the notification!

Great! Thanks a lot for doing this so quickly!


Fixed installation and first-run instructions

Add bower to deps.
No need to globally install gulp.
Web server runs on port 8000.
Formatting.

Thanks! 👍


Fix header vertical spacing and jupyter-sphinx cells

This does two quick things:

Makes the height of our header dependent on the items in the header, rather than fixing the height of the header itself. Fixes https://github.com/pydata/pydata-sphinx-theme/issues/1163
Fixes and simplifies some CSS for the jupyter-sphinx extension that I noticed while demoing this.

A nice benefit of this is that if the header is now empty, it disappears completely!

how can you generate a header with nothing

I was thinking about the book theme actually - that one doesn't use the header at all for now and has to manually set it to display: none, but I think it could instead just over-ride the header templates to be empty, which would effectively make it disappear. Then if somebody else wanted something in the header they could add a template and it would magically reappear

Thoughts on whether we can live with https://github.com/pydata/pydata-sphinx-theme/pull/1164#discussion_r1100663685 ?
I'd like to get these last few bugfix PRs merged so that we can cut a new RC!


Add a Kubernetes quickstart

This adds a Kubernetes quickstart based on the Guestbook application,
and also updates our homepage and footer navigation to more closely
align to the more recent pulumi.com updates where Kubernetes takes the
place of CoLaDa as our "fourth pillar."

I think flipping polarity is probably a good idea, however, it is amazing
how often I see this referred to online tripping folks up ... I probably
have to do more queries on K basics than you guys in order to understand
what i am looking at, and the confusion runs wide
On Tue, Aug 21, 2018 at 2:33 PM, Joe Duffy<EMAIL_ADDRESS>wrote:

@joeduffy commented on this pull request.
In quickstart/kubernetes-guestbook.md
https://github.com/pulumi/docs/pull/552#discussion_r211767418:

The HTML from the Guestbook will be fetched and printed:

 <head>

 <title>Guestbook</title>

 ...

If you are instead running this program in a real cluster, you can change ClusterIP to LoadBalancer above,
run pulumi up to update it, and then you can simply access your Guestbook application with:

$ curl $(pulumi stack output frontendIP)

I'm fine doing that, but I'm going to flip the polarity (and think we
should on the example also). Basically, assume there is no load balancer
unless explicitly stated; this is simpler, and for the newbie users that
are relying on Minikube, it's one less thing to grok when you're just
trying to get up and running. Presumably folks with a real cluster will
actually know they need a load balancer, whereas these newer users won't
know they don't need one.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/pulumi/docs/pull/552#discussion_r211767418, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AH_5wkC--Ion7wpiraOaxgoXsd3zbltCks5uTHytgaJpZM4WFznB
.


operator eginnovations-operator (v0.0.3)

Signed-off-by: Gaurav Singh<EMAIL_ADDRESS>

/retest


performance during pull export degraded after last upgrade

I'm exporting my entire library with a command line script.
Before the last update (0.7.33 at least I noticed it with that update) it took between 5 and 10 seconds. Now it is consistently about a minute.
Perhaps you already know / have some hints to the cause?

Wow, that's a huge difference. So this was introduced with .33? I don't immediately see anything that could be the cause of this yet -- it would be helpful if you have some idea about what version had the more desirable performance.
For another test, could you upgrade to .34, and set extensions.zotero.translators.better-bibtex.caching in about:config to true, and then run your script twice... if the caching is effective, the second (and following) runs should be much faster.

As an aside, would it be possible to export your library to Zotero TestCase and drop the result in https://dbinbox.com/allthatisthecase? That way I could do more directed tests.

Could you see if this makes any difference: https://dl.dropboxusercontent.com/u/5300806/zotero-better-bibtex-0.7.34.xpi

Really odd. If I look at the timing at CircleCI and Travis, if anything, the export has gotten slightly faster.

just upgraded to .34
With caching enabled the export takes much longer - I did not let it finish. It was running for about 5 minuttes with very heavy disk access during the export.
Disable cahing again and back to about one minute (a little more after a zotero restart, a little less after running once). No noticeable disk access during export with cache disabled.

I'm running zotero 4.0.26, standalone. With Zotfile, linking to my files placed outside of zotero folder.

just sent you my zotero library as test case.

testcase export went quick - a manual (no url) better biblatex export (even without collections) also takes about a minute.

actually it is not a big problem for me - just thought I'd report it. Luxury if we could get back the old performance though:) It could also be related to the last few zotero updates - dont know what is the cause. My library have not grown so much lately (pehaps a 50 to a 100 more references - max!- after the problem began)

my export script:
#!/bin/sh
curl --connect-timeout 5 -o Zotero.bib http://localhost:23119/better-bibtex/library?library.biblatex

I don't think it relates to Zotero upgrades -- the last Zotero upgrade was from before .33. I do consider this performance loss to be a major issue; at some point, script timeouts are going to break stuff. The testcase export hardly does anything, so that speed is easily explained. That caching makes things worse is also not great.

Ah wait, with caching, did the first-time full export take very long, or the second? The first would be a little (but just a little) less worrisome than the second.

With caching it was impossible - I never let the first run finish - stopped it after 5 minuttes. With caching enabled, there was intensive diskaccess. Does the caching perhaps access the attached files or something like that? Related to some combination of zotfile and betterbibtex?

sorry forget about the caching issue! There must have been some other problem last night:)

Okay here we go:
I enabled caching.
First time: 20 seconds
Second time: 6 seconds.
Seems we have good performance again.

Just a quick question: How is the cache of items invalidated? On edit of an item?

Wait what? The 20 seconds is for your full library? What happened?

Yes. I cannot reproduce the one-minute export time any longer, even though they were consistent for a long period of time. The 20 seconds is about normal for a freshly started zotero.
I must admit it could have been a local problem on my side - I'm really sorry for the noice if that is the case.

The cache for a reference is invalidated when:

it has a dynamic (non-pinned) key, and either:

a pinned key is generated that equals its current dynamic one
the format pattern is changed

it is modified in any way

The cache for a reference is retained but ignored when:

Any of the BBT settings change except the format pattern.

The latter is an outflow of the fact that cache entries are saved relative to their "context", which is largely just the relevant export settings; I'm still thinking about a non-aggressive way to reap those. I have caching enabled myself, and the automated tests do too, but I want to wait for public release of the feature until I have an idea about cache reaping. Unless you change settings often (which I do as part of dog-fooding BBT) you shouldn't have to worry about cache pollution too much.
The caching doesn't touch the attachments in any way, just the references.
As an aside, I'd hugely prefer it if people wouldn't apologize for reporting problems, even if they do turn out to be transient. I'd rather have one reported too many than have one reported too few, and I appreciate the time people take to get me debug information.
If you choose to keep caching enabled, don't hesitate for a second to report any problems, but please do make mention of it when you do report.

Allright, thanks for the caching info - this seems sensible. I keep cache enable for now.
And I like your policy on bug reporting. Next time I'll try to reproduce on a freshly booted machine, though ;)
Thanks again for the communication speed! Really apreciated.

It is my pleasure.

No such reports are ever in vain. It prompted me to work towards releasing the caching and add the cache test to my automated builds, and it's pretty clear I need to get this out. Your library is now the basis for the cache tests, with these consistent results on travis:

Unprimed cache: 57 seconds
Primed cached: 3.56 seconds

Even on my slow dev system I consistently get a factor 10 speedup. Relevant difference I should think! And I also think I've found a nice way to do cache reaping.

Great!
I had some trouble getting changed items exported when caching is enabled (editing the author for instance) Disabling cache of course got me the updated data in the export.
Is this a bug or should the bibtex key change? I interpret what you described above that any change of an item should invalidate the cache for this item?

This is most definitely a bug. I think I've found it, tests are running.

OK, fix is out.

super - I'll upgrade

Ok - seems to be working. Thanks for the quick fix!

Phew - great. Cache reaping is currently (quite arbitrarily) set at one month after last access.


Replace deprecated npm packages

MapLibre seems to depend on some deprecated npm packages.
To reproduce

git clone --recurse-submodules https://github.com/maplibre/maplibre-gl-native.git
cd maplibre-gl-native
npm install

Expected
Expected no warnings.
Observed
$ npm install
npm WARN deprecated<EMAIL_ADDRESS>No longer maintained. Use [lru-cache](http://npm.im/lru-cache) version 7.6 or higher, and provide an asynchronous `fetchMethod` option.
npm WARN deprecated<EMAIL_ADDRESS>this library is no longer supported
npm WARN deprecated<EMAIL_ADDRESS>The querystring API is considered Legacy. new code should use the URLSearchParams API instead.
npm WARN deprecated<EMAIL_ADDRESS>Please upgrade  to version 7 or higher.  Older versions may use Math.random() in certain circumstances, which is known to be problematic.  See https://v8.dev/blog/math-random for details.
npm WARN deprecated<EMAIL_ADDRESS>request has been deprecated, see https://github.com/request/request/issues/3142
npm WARN deprecated<EMAIL_ADDRESS>This package has moved to the @mapbox namespace. All new version are available via @mapbox/mapbox-gl-styles

Platform
npm 9.3.1, macOS 13.1 (build 22C65), Xcode 14.2 (build 14C18)

To get deprecation warnings is pretty standard for any project that uses Node.js.
async-cache is a dependency of st: https://www.npmjs.com/package/st
har-validator is a dependency of request which is in maintenance mode

maplibre-gl-js/test/ajax_stubs.js
platform/node/README.md
platform/node/test/suite_implementation.js

#322 #657
querystring is a dependency of aws-sdk which I think we are not using
uuid can probably be updated
mapbox-gl-styles can probably be changed to maplibre-gl-styles


PDFx Docs should explain that controller must be rebuilt when rebuilding UI

Describe the bug
I spent far too long to work out why my pdf would draw but not redraw. Looks like it was because my controller was final. The docs should say not to do this (and ideally explain why; which I still don't know)
To Reproduce
Steps to reproduce the behavior:

Set up final controller for pdfx widget. Cause it to draw and then redraw. Wonder why it doesn't redraw. Try to find out why.

Expected behavior
Documentation should explain how to do it properly. Ideally, the controller would tell me what I'm doing wrong with a warning.

I got same problem, i need to redraw the pdf controller but doesnt work

Hi all, got anyone solve this bugs? i can try redraw a pdf document but dont work

I got the same problem when moving from dark theme to light theme while viewing pdf document
Here's how I reproduced the bug:
https://user-images.githubusercontent.com/75757472/204158074-40420d65-9a6f-459f-b887-aab9a055bef6.mp4


SubProcess replace breaks contained labels

Reproduce

Create subprocess with task named FOO\nBAR inside
replace with event-subprocess
labels in task are broken visually

Expected

[ ] Labels are properly layouted after replace

May be related to https://github.com/bpmn-io/bpmn-js/issues/660.


How to save the session?

Hello, first of all I want to congratulate you on the library, it is the most complete I have seen. I have a question, how can I save the Instagram session so I don't have to enter my username and password all the time.
Thank you very much!

Answered via telegram


Any experiment result that can conclude the sentence piece Japanese BERT model outperforms word piece one?

Do we have any result to support that the sentence piece is better?

(I assume word piece you mention here is the word piece tokenizer used in the original BERT repository.)
Although I don't know a perfect comparison between them, I strongly believe BERT with SentencePiece is better.
The reasons are as follows:

The word piece tokenizer is completely depending on the white space tokenization which is obviously not for Japanese text (the word piece tokenizer almost acts as a character-by-character one). Of course, this is not absolute since sometimes a character based tokenizer is better.
Previously I compared BERT with SentencePiece with BERT with WordPiece (precisely, the pre-trained multilingual BERT model provide by the original BERT repository). The former is clearly better (sorry this blog post in Japanese): https://techlife.cookpad.com/entry/2018/12/04/093000.

Got it! Thank you very much for your explanation. We are now also experimenting the sentence piece on the Japanese corpus. We will also update the result and hear your comments. Thank you!


Bug: Duplicate Display Issue with Pinned Directories in the Favorites Bar in the Quick Access Home Page

Description
Hello, I have noticed an issue where any directory I pin to the Favorites bar in the sidebar on the Quick Access Home Page is displayed as a duplicate entry.
Steps To Reproduce

Right-click on a folder
Click on "Add to Favorites"

Requirements
Identify the cause of the duplicate display issue for pinned directories in the Favorites bar.
Files Version
Version : <IP_ADDRESS>
Windows Version
Windows 11 22H2 22621.1702
Log file

Thank you reporting this issue.

I'll look into this

@Lukiluc29 this issue should be resolved in v2.5.


[CSS] Progress bar styling changes

Currently the percentage/progress bar is not completely visible, adjust accordingly

PR Raised: https://github.com/entdec/satis/pull/179


fastfurnace lost items

I do not know if it's the right place, but spongeforge does not usually help with compatibility issues with mods.
I'm using the SkyFactory4 modpack (v4.0.2) on a spongeForge RC3616 server and everything worked fine.
But I updated sponge to RC3679 because it repairs serious bugs and now the FastFurnace ovens do not work. Sometimes what is cooked is lost, other times the oven stays on all the time even when it is empty.
I do not attach a log because there are no errors or warning messages.

I mean, if it worked before, and sponge changed, then it very much sounds like a bug with sponge.  Don't think theres anything I can do about it.

Sponge says this bug is you and not them. Can you confirm if this has been resolved in latest version. This issue is happening in Skyfactory 4 pack but i cant just update mod.
https://github.com/SpongePowered/SpongeForge/issues/2702


Cannot update the schema of already existed table

Code snippet in kotlin :
val bigQuery = BigQueryOptions.newBuilder()
            .setHost("http://<IP_ADDRESS>:9050")
            .setProjectId("test")
            .setCredentials(NoCredentials.getInstance())
            .build().service

        val tableDefinition: TableDefinition = StandardTableDefinition.newBuilder()
            .setSchema(Schema.of(
                Field.of("id", LegacySQLTypeName.STRING)
            )).build()

        val tableInfo = TableInfo.of(TableId.of("internal", "test"), tableDefinition)

        bigQuery.update(tableInfo)      // first call it with .create() so it will create the table

so I have the issue:
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 500 Internal Server Error
POST http://<IP_ADDRESS>:9050/bigquery/v2/projects/test/datasets/internal/tables/test?prettyPrint=false
{
  "code" : 500,
  "errors" : [ {
    "location" : "",
    "message" : "unexpected request path: /bigquery/v2/projects/test/datasets/internal/tables/test",
    "reason" : "internalError",
    "debugInfo" : ""
  } ],
  "message" : "unexpected request path: /bigquery/v2/projects/test/datasets/internal/tables/test"
}

Since the combination of a POST request and this request path ( bigquery/v2/projects/test/datasets/internal/tables/test ) does not exist in the API Reference, this request does not appear to be processed correctly. Are you making the request using the official client SDK?

Yeah, you are right, dont see it on Google's AP page.
However I use the original Maven lib from google for that com.google.cloud:google-cloud-bigquery:jar:1.126.6:

I see. BTW, what happens if the request destination is a real BigQuery?


Distros Missing After Drive Upgrade

I know I am not using the template
So strange thing today, I upgraded my nvme drive today. Went from 500GB to 1TB, but now my WSL distros are missing.
what I did:

use DD to clone one drive to other dd if=nvme1n1 of=nvme0n1
deleted recovery partition next to the primary.
extended partition to use remaining space.

Is there anything that would have caused my distro's to go missing by doing what I did above. By all rights the drive were identical except for size. Even when I booted up windows, it took the old drive offline because the id's matched.

@outcast I'll close this issue out since you haven't used the template, and we need that information to be accurately able to help you.
However I want to also give you some advice for troubleshooting. In general, your Distro files are stored in C:\Users\<yourUserName>\AppData\Local\Packages with names that start with things like: 'CanonicalGroupLimited.Ubuntu'.. for a Distro like Ubuntu. Are you able to check for that folder and see if your distro files exist there?
If you'd like further help on this issue please reopen it with the template filled out. Thank you!


fix: GCDSlice returns 1 when slice is empty

Signed-off-by: lowzj<EMAIL_ADDRESS>
Ⅰ. Describe what this PR did
The GCDSlice does not consider the situation when the giving slice is nil or empty.
This pr makes it returns 1 when s is empty because that any number divided by 1 is still
itself.
Ⅱ. Does this pull request fix one issue?

Ⅲ. Why don't you add test cases (unit test/integration test)? (你真的觉得不需要加测试吗？)
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

Codecov Report

Merging #1302 into master will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #1302      +/-   ##
==========================================
+ Coverage   51.20%   51.21%   +0.01%
==========================================
  Files         124      124
  Lines        8152     8154       +2
==========================================
+ Hits         4174     4176       +2
  Misses       3639     3639
  Partials      339      339

Impacted Files
Coverage Δ

pkg/algorithm/algorithm.go
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 734cde5...972cba1. Read the comment docs.

LGTM.


Redesign focus outline styles

Why is a solid outline preferable to blur?

I think it looks better (my opinion…) and it creates a harder edge with more contrast.


⚠ Bofrost.at has degraded performance

In 384bd0b, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2511 ms

Resolved: Bofrost.at performance has improved in 514b12e after 30 minutes.


long name changes & landice gc modifications to support R21C history

This pull request is paired with PR#371 in GEOSgcm_App and address points in PR#637. The modifications touch the SURFACE grid comp and children including land, landice and saltwater.
I introduced the following changes:

In SURFACE, the long name/description of AICE was changed to “sea_ice_covered_fraction_of_ocean_area”  and the long name/description of FRSEAICE was changed to “sea_ice_covered_fraction_of_grid_cell” . Following discussions with several people, the long names were NOT changed in Saltwater because the reference to ‘tile’ remains correct in those instances.

Long name changes to ALBVF, ALBNF, ALBVR, ALBNR in which ‘reflectivity’ replaces ‘albedo’ in SURFACE and all children for consistency. This supports the inclusion of ALBVF, ALBNF in the rad collection and distinguishes them from these variables exported from ‘SOLAR’. This decision may require modifications/discussion.

Long name changes to RAINREFREZ (contribution_to_smb_from_rain_frozen_onto_bare_ice) and EVAPOUT (water_vapor_vertical_flux_at_glacier_surface) in LANDICE. These are landice specific exports.

A change in sign was applied the the GHTSKIN export from LANDICE to rectify a conflict with the variable sign in LAND. This change was confirmed with a short test. Figure included.

Let me know if any issues arise or if there are any questions or comments.

This branch was merged into feature/rreichle/r21c_updates and changes are addressed in pull request #637.


Add support for python 3.13

Python 3.13 came out 2 days ago
Wait until #302 is completed
We need to :

[ ] add the version support in all toml files
[ ] add entries in the workflow matrix
[ ] add an entry in the policy definition if #327 has been completed before this issue.

this package pulls an abandoned pendulum package:
https://github.com/sdispater/pendulum/issues/844
https://github.com/sdispater/pendulum/issues/590

this is currently blocking us from upgrading to Python 3.13. Any ETA?


Faulty login throws server error

Hi!
I'm implementing an authorization code grant flow in my app. During this process I learned that I need to implement my own authentication handler which I've done.
The documentation says that this function should return a falsy value if no user could be found. Which I interpret as no user matching the provided username and password.
I'm hooking into my model's getUser which fulfills this requirement.
This is where the problem occurs. This code throws a server error whenever no user is supplied. Which would be anytime someone types the wrong username or password. https://github.com/oauthjs/node-oauth2-server/blob/e1f741fdad191ee47e7764b80a8403c1ea2804d4/lib/handlers/authorize-handler.js#L241
Is this as intended? If so, what is the suggested solution? I can't really assume all server errors are faulty logins :)

What does your authentication handler look like?  How are you invoking it as part of your authorization flow?

I guess this comes down to how the instructions are read.

If there is no associated user (i.e. the user is not logged in) a falsy value should be returned.
I assumed passing a false value would return something useful or flow into a state which I would have to handle, like sending a 400 or sending the user back to the login page. I did not expect to the thrown a ServerError that I can't really use. I shouldn't be requested to send a falsy value when it doesn't help me.

I rewrote my code following some examples I found. In this new flow I would never send a falsy value (jinx!) making this problem rather small.

@Dronar You don't have to apologise as it wasn't the wrong assumption. The docs here are clearly rubbish as my understanding of it was exactly the same as yours and I wasted hours trying to make sense of it.
The handle function should be the place where you either return a user object or null, as there is no other Model function that validates a retrieved user. Had there been such a Model function (validateUser() say) that is called before the call to saveAuthorizationCode(), it would make sense to always return some object which could then be validated within validateUser().
However handle does not like null being returned and there is no such Model function, leaving us to write logic within POST:/authorize itself to validate and redirect with error upon failure - @Dronar I'm guess you did something like this?
Kind of defeats the purpose of such libraries, which exist to abstract away details of the OAuth flow.
Also, no further responses from the contributors since Feb 2018!?


analyze "referential integrity" of field

In the "data quality", there is a lack of quality analysis on referential integrity of fields.
Currently, it is only possible to specify whether column values are in a "specified set", without analyzing if their values are in a column of another table

This is on the roadmap of the SaaS (won't be available in OpenMetadata) https://www.getcollate.io/roadmap


Remove precompile(true) from included files

In the included files __precompile__(true) is used but this seems not to be required

Removed by 6a83041d423cf158e38408cbb0c46d3abc23eaa9


Create 1846C.cpp

Add Codeforces 1846C

@ErukulaRajasree your PR is merged, feel free to star the repo, so everyone can find it <3


Document mitigation strategies against servers being taken into LB rotation prematurely on Marathon

Specifically, outline why relying on a green Marathon health check is not an option due to leader election.
Refs #1185.

@timoreimann could we close this issue?

@ldez yes, definitely -- #1578 documented everything.


help: basic api-json example

HI thx for the initiative,  i would like to have a little bit help,
i just tried a simple json from the User Model as given as example  and the response json i get is  not what is expected:
{"id":"1411","selfRel":null,"allSelfRel":null,"firstRel":null,"lastRel":null,"nextRel":null,"previousRel":null,"relatedRel":null,"username":"john mapamba"}
that is waht i am geeting back instead of the structure :
 {   "data": {     "attributes": {       "username": "the username"     },     "id": "the id",     "type": "User"   },   "links": {     "self": "http://localhost:8080/user/the+id"   } }
I would like to know if the mistake  is from mine other should i correct something :
`@JsonApiObject("User")
public class User  extends JsonApiDtoExtendable {
private String id;

@JsonApiProperty
private String username;

public String getId() {
    return id;
}

public void setId(String id) {
    this.id = id;
}

public String getUsername() {
    return username;
}

public void setUsername(String username) {
    this.username = username;
}

}`
the above class  is the one  i used and on the controller side , i just created a basic instance with id and username
that i tried to display as json .
I am using spring boot 3.0.6
Any help will be welcomme

Hi @MieskeB , it is working fine with the converter , my Bad
That means we should always render the ResponseEntity as a String .
I am just asking myself if we can not improve it so that when
using the controller we won't need to convert the object no more
Thank for the work . it is really intituiv to use

That is a very good suggestion to which I didn't think of before, I will look into it!

I will open a new more descriptive issue about this topic and close thisone now. If you have other questions, feel free to open it again.


[DNM] Try copy_on_write in CI

I was chatting with @phofl and he mentioned pandas 2.0 has a bunch of performance updates related to copy_on_write. This PR just turns copy_on_write on in our test suite to see if anything breaks

Opened #9944 to fix the chained indexing failures. Found 7 more:
test_attrs_series_in_dataframes

This test works now, so would have to conditionally xfail?
test_split_apply_combine_on_series
test_apply_or_transform_shuffle
test_apply_or_transform_shuffle_multilevel

Those tests fail for the same configurations (2 each). The following happens there:
df = pd.DataFrame({"a" [1, 2, 3], "b": 1})
df.groupby(df["b"]).sum()

pandas identifies that your column is part from your DataFrame (as does Dask) and so the aggregation is not computed over it. This works as expected.
df = pd.DataFrame({"a" [1, 2, 3], "b": 1})
df.groupby(df["b"] + 1).sum()

In this case the groupby key is not a part of the initial DataFrame, e.g. you'll end up with a result where the index is named b and you have 2 aggregation columns, a and b again. Dask right now does not add b to the columns again (it does without CoW).

The groupby failures have to be fixed upstream. I opened https://github.com/pandas-dev/pandas/pull/51442 to address this.


Is there any code examples about how to use attention in Haiku?

Hello,
I am trying to add an attention layer to LSTM, but not find any examples about using Haiku.MultiHeadAttention.
Is there any code examples about how to use Attention Layer in Haiku?

Our transformer example includes a subclass of MHA and you can see it being used here.


Mount database on sql server by code

From @mferraricloudsurfers on September 5, 2018 7:39
Starting from mdf and ldf files and knowing the sql server connection credentials, I want to mount the database by code using .NET Core 2.
Is it possible?
Copied from original issue: dotnet/coreclr#19834

I don't think coreclr is the right place for this issue, but I'm not sure where to redirect it, so moving to core in hopes of finding the right home.

I think this could be a good start point: https://stackoverflow.com/questions/35700066/attach-database-programmatically
This gives you a lot of informations and code: http://justlikeamagic.com/2010/04/13/programmatically-enumerating-attaching-and-detaching-sql-server-databases/
This is another short example: https://stackoverflow.com/questions/4218960/how-to-restore-sql-server-database-through-c-sharp-code
None of these are made using Net Core but since we are talking about SQL queries, and not about C# functions, you have all the information and probably most of the code is copy and paste.

Issue moved to dotnet/corefx #32208 via ZenHub


Doesn't pick up video elements on TeamCoco

Didn't work on https://teamcoco.com/video/lisa-kudrow-on-the-latest-fake-friends-movie-trailer

Hey,
Thank you for the report, not entirely sure why that's the case as on paper everything should work just fine, I'll try to find some free time to investigate this.


Verify that custom constraints are working as expected

See title

Fixed SAME, NOTSAME custom constraints bug.

Weights for predefined constraints fixed in cb53c27.
Weights for custom constraints fixed in 3deef5a


GW - test gives wrong values

Hi,
I wanted to give a try to the GW module of PySCF. However, running the test included in the file pyscf/gw/gw.py gives different results for the energies than the commented values in the code (line 400) which I assume are the reference values.
I attached the output I get from running python gw.py
gw_output.txt
Is the code outdated?

The problem is with your DFT calc, not GW -- you can see in the output that
the numbers are way off, nelec integrates to 0.0, the SCF doesn't converge,
etc.  I would guess that your libxc is not properly
included/compiled/linked.
On Sun, Feb 23, 2020 at 2:15 PM mbarbry<EMAIL_ADDRESS>wrote:

Hi,
I wanted to give a try to the GW module of PySCF. However, running the
test included in the file pyscf/gw/gw.py gives different results for the
energies than the commented values in the code (line 400) which I assume
are the reference values.
I attached the output I get from running python gw.py
gw_output.txt https://github.com/pyscf/pyscf/files/4242198/gw_output.txt
Is the code outdated?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/pyscf/pyscf/issues/529?email_source=notifications&email_token=ADGAJC36RMJONYKUT5MZZMDRELDOFA5CNFSM4KZ5CPK2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IPSRHQA,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADGAJC673BGQC3E7WI4HOVTRELDOFANCNFSM4KZ5CPKQ
.

Does the regular HF calculation give right result? I couldn't reproduce your test. The commit c3b3584e6690d27ff28efafbf106178dae6cd6d4 in your output seems not in the main branch.

Thanks for your comments.
I used the dev branch, may explain the commit that you saw.
I will check libxc, but I did not see any issue during the compilation, maybe a linking problem as you mentionned.

I tried dev branch, couldn't reproduce the problem. Your output log looks like a problem associated to analytical integral or JK builder. Can you try cleaning up all compiled libraries, (inlcuding the depedent libraries, libcint, libxc, libxcfun) and test gw again?

I tried a clean installation and it work out. Probably I mess up somewhere the first time.
Thanks for your helps!

Note that another implementation of GW will soon be released.
On Mon, Feb 24, 2020 at 2:47 AM mbarbry<EMAIL_ADDRESS>wrote:

I tried a clean installation and it work out. Probably I mess up somewhere
the first time.
Thanks for your helps!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/pyscf/pyscf/issues/529?email_source=notifications&email_token=AAN5NRG6LYXFGNIOHKY3N23REOQUBA5CNFSM4KZ5CPK2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMXK73A#issuecomment-590262252,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAN5NRBNPT2CYNRKX5R3ZQ3REOQUBANCNFSM4KZ5CPKQ
.

Thanks for the info. Is it possible to have a look at this new version?

Yes, but we will push very soon anyways, I'll look into it.
On Mon, Feb 24, 2020 at 9:39 AM mbarbry<EMAIL_ADDRESS>wrote:

Thanks for the info. Is it possible to have a look at this new version?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/pyscf/pyscf/issues/529?email_source=notifications&email_token=AAN5NREXMEJT2X2HCZJQIJDREQA65A5CNFSM4KZ5CPK2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMY2W7A#issuecomment-590457724,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAN5NRC3GZNIE4NIV23FGSLREQA65ANCNFSM4KZ5CPKQ
.

Hi @gkc1000 ,
Any update on this new version of GW?


feat: create tests for tags

ref #356

@Sembauke I think this is fine, now. All the tests can be run repeatedly and in any order and should not cause any issues.
Once we have a lot of tests, it might be worth using api calls to setup/teardown any state we need for the tests. Just to speed things up. However, for now, I think this approach is fine.

I'm having difficulties running playwright tests locally

What's going wrong, @sidemt? It sounds like I need to update the docs.


Link from https://people.gnome.org/~tvb/buildstreamdocs/ to https://buildstream.gitlab.io/buildstream/

See original issue on GitLab
In GitLab by [Gitlab user @samthursfield] on Nov 10, 2017, 14:39
The pages at https://people.gnome.org/~tvb/buildstreamdocs/ are out of date, but they still seem to show up in Google searches for some people. They should just redirect to the new location if possible.

In GitLab by [Gitlab user @tristanvb] on Nov 13, 2017, 09:29
The buildstream documentation was generated on gitlab pages in the first weeks of it's creation, if I ever put up docs in my home dir it was only to privately share while sphinx docs was a work in progress.
Just removed them, I prefer a 404 more than people actually accessing buildstream docs via my homedir.

In GitLab by [Gitlab user @tristanvb] on Nov 13, 2017, 09:29
closed


'export_pairs' is not working due to missing 'write' function

Describe the bug
'export_pairs' is not working due to missing 'write' function
To Reproduce
add w.export_pairs() to WorkFlow.ipynb
Expected behavior
export pairs as a dataframe
Screenshots
NameError                                 Traceback (most recent call last)
Cell In[18], line 1
----> 1 w.export_pairs()
File site-packages\pyjedai\workflow.py:195, in PYJEDAIWorkFlow.export_pairs(self)
189 def export_pairs(self) -> pd.DataFrame:
190     """Export pairs to file.
191
192     Returns:
193         pd.DataFrame: pairs as a DataFrame
194     """
--> 195     return write(self.final_pairs, self.data)
NameError: name 'write' is not defined
Desktop (please complete the following information):

WIN 11, Chrome, pyjedai 0.1.7

Additional context
in the past 'write' was in evaluation.py

Thanks for the detailed report. It is fixed and will be updated in the next public release!


update links to spec pages

This is a companion PR to https://github.com/D-Programming-Language/dlang.org/pull/896. Do not pull without that one.

Auto-merge toggled on


Installed 0.2.0 from Nuget for Droid project but assembly does not match code?

Having installed Xamarin.RangeSlider 0.2.0 into my Xamarin Droid project (Xamarin.RangeSlider.Droid) I can't see properties such as 'DefaultColor', 'ShowLabels', 'ThumbImage' etc. in intellisense. Looking at Xamarin.RangeSlider.Droid in the Assembly Browser and the RangeSliderControl class doesn't seem to match the latest code here on GitHub. The only public property seems to be 'NotifyWhileDragging'.
I have also tried version 0.1.6 and this too seems to be the same older version?
I have downloaded and built latest and all works fine so it does seem as the Nuget packages are using older versions of code/assemblies.

Thanks a lot @msivers
Looks like I packaged wrong version last time. Check out version 0.2.1.


Make universal routes work for controller middleware

This PR allows support for controller middleware. $route->computedMiddleware is equal to Router::uniqueMiddleware(array_merge($route->middleware(), $route->controllerMiddleware()));. So basically the same result as before, but with the controllerMiddleware added. I have added a test, which should cover this use case.

@stancl Could you take a look at this PR. For my projects this would be the last puzzle piece to make Tenancy v3 work with Livewire v3

Curious how you're using controller middleware with Livewire. Are you specifying it in the component in some way?
And is there a reason you can't use route middleware here?

Livewire v3 itself now uses controller middleware for the File Upload feature by using the getMiddleware() function. Now that this Livewire PR is merged, we can define ['universal', InitializeTenancyByDomain::class] inside the Livewire config and apply the correct tenancy middleware for the file upload routes.
With the way this feature is coded now, there is no other way to apply middleware to this route. A PR was opened to allow custom Route definitions, but that was closed due to issues with the implementation.

@chillbram Does your PR handle: this route as well? https://github.com/livewire/livewire/blob/1ec54cdf57c6f1bf734bb14f9732904473b91c3f/src/Features/SupportFileUploads/SupportFileUploads.php#L38
And wouldn't your array_map() lead to route definition like this:
[
    [
      "middleware" => "tenancy",
      "options" => [],
    ],
    [
      "middleware" => "universal",
      "options" => [],
    ],
]

Which I think should be:
[
    [
      "middleware" => ["tenancy", "universal"],
      "options" => [],
    ],
]

I see, so the usage of options would be (in a generalized example) something like this?
Route::group([
    'prefix' => 'foo',
    'middleware' => [
        ['middleware' => FooMiddleware::class, 'options' => ['options for foo middleware']],
        ['middleware' => BarMiddleware::class, 'options' => ['options for bar middleware']],
    ],
], function () {
    //
});

I don't think your code example works when used like that on the Route:: facade. But if you'd move that middleware array to a getMiddleware() function in a controller, that would have the result you'd expect. Controller middleware isn't really documented I don't think, so we kind of have to live with their quirks.

@stancl Do you agree with this implementation and its test coverage?

We're looking into this at the moment. The solution used here is causing some issues with how we do things in v4, so we're looking at other ways to approach the problem.

@chillbram could you try if changing the Livewire code locally like this fixes the issue for you?

It works for files uploaded on a tenant, but not on the central domain. Universal routes don't seem to work with this implementation yet

I submitted a PR to Livewire with a similar implementation to the one I linked.
Once it's merged, if you could check whether the changes submitted here work with the new version of Livewire, I can merge this.
Our priority is Livewire 3 support in v4, but since this is essentially a one line PR and doesn't appear to break any tests, I can merge this into v3.

Just checked and this change still works with Livewire v3.4.1, so I think this is safe to merge into Tenancy v3

I added a fallback to middleware() in case this code was ever executed before computedMiddleware got filled (since the value of that property depends on the point in the lifecycle where the route is referenced, i.e. gatherMiddleware() needs to be called first).


When removing liquidity, there should be a message of some sort to tell the user it has not enough ERG to do the transaction

https://imgur.com/a/KsfMEJx
I have almost zero erg in my wallet (as you can see from the screenshot above).
I tried removing liquidity from the SigUSD/ERG pool, but it looked like the ui bugged because the "Remove liquidity" does nothing.
I know it's because I don't have enough ERG to pay for the transaction, but it would be nice to
a) get a message in the UI telling me so
b) not have a "undefined" javascript error in the console.

I am on linux with brave Version 1.34.81 Chromium: 97.0.4692.99 (Official Build) (64-bit)